Looking at your last pic, there seems to be a radius in the corner of the fretboard/ neck join. The edge of the fret board doesn’t appear completely square either.
I would use a very sharp, very flat backed chisel and run it down that radius, with the flat held down against the nut ledge. It is either that or try to get a square file in there to square that all up