Yes, my first option will be to route them out, I have purchased new ones to put in.
Since the hole will be too big, I am debating filling around them with red abs or maple chips. I'll see how I go.

I need to build a router base for my rotary tool first. 😀