Would getting some sealer in there help adhesion?
I can't imagine it would. (wood??? ) Typically bonding to timber is best achieved with clean natural fibres exposed. It would be akin to trying to glue two pieces of painted timber together.

This won't help with your adhesion issue, but since your stamp ink is water based, you can also use it to tint the Timbermate prior to application.