I'd guess that even with the slightly bigger hole, you'd probably get a crack appearing once you used the trem. All down to the wood being weak rather than your actions. As long as it's now stabilised and you can hide it, then no great harm has been done.

And there's always the 'paint the cavities black' option.