I'd give it a very light mist spray with primer or a main colour so you can then sand that back and see where the high spots and dips are. And if you use a large flat piece of wood and stick sandpaper on to it with double sided tape (or use the superglue and masking tape trick), then you should only end up sanding down the high spots first, and then everything else evenly.