Or you could sand it down with a sander bit, just press it up against the metal. Do not sand at an angle, that would turn the metal's end into a sharp edge. It has worked fine for mine so far.
Just make sure to take your time with it and to touch the edge regularly to make sure it is not sharp. And take some scrap wire and tug it hard against the edges.