The end grain of the dowel will likely show up much darker under your final finish coats also, so you may end up with Avery stark contrast. Depending on how handy you are with paint, you coul try to blend them to the surrounding wood.
Your build sounds very interesting, please post some pictures if you get a chance 😁
FrankenLab:
Turning tone wood into expensive sawdust since 2016!