So everyone it seems the general idea is to sand the sides back a bit until it seems snug but not impossible?

Yeah I might leave it for a few days just to plan/get the equipment/ give the kit some time to settle.