Mandrel for hole saws