Some sage advice from McCreed above, those divots need to be sanded out. I would certainly recommend at least 4 weeks drying time. Just out of curiosity how many coats of poly did you wipe on? (I don’t think I’ve ever stopped before 40 coats).