nice job, shame about the fret board.
i have done similar fixes this way:
put a few drops of grain filler onto the affected area. Whilst it is still wet, gently sand or scrape (with the edge of a razor blade) the timber area affected - if you are gentle it wont hurt the fretboard or take away too much material.
Move the resulting slurry around with your finger and use it to fill the gaps.
Leave it to dry hard, gently sand flat again - it gives a near seamless repair.