Or just another bit of wood that you can use small clamps on either side of where the hole is going to provide something to drill into.

Or stop just as the tip of the drill is breaking through and use a small round file to enlarge the inside opening. A Brad point drill should also help to keep things clean.