Grain filler mix look rather watery? If it all sands off maybe reapply it a bit stiffer consistency and use an old credit card as a squeegee to really squeeze it into the pores.