That would be a much simpler and less invasive solution. I did a quick search and so far have not identified "cheap:" and "robust" in the same package. The bolt I am using fits the buffing wheel well and just barely fits in the 1/2" (13mm) chuck...but... If I can find a suitable adapter. It would eliminate the potential for wear and tear on the drill-press's bearings as well. If I can find a cheap enough adapter, it wouldn't matter much if it wears out. Besides the strain on the right angle adapter at 600-750 rpms has to be pretty minimal.
Putting this on my shopping list ;-) Thanks for the suggestion.