A good idea, especially if its only one pot affected (Closest to the cavity wall). The trick is going to be the plug and re-drill, as long as you can get that sorted to satisfaction, then the door shim washer will work fine.
Like Fender3x says you can shape it, install it and fine tune before you go gluing it, if you even want or need to glue it, it's only a spacer after all.