The wet rag trick will show you how much to go - key part is once you've had enough sanding for the day wipe it down and let it dry (could take anything from a couple of minutes to half an hour) and as Franken says above, any loose fibres will stand up and be easier to knock off the next sand.