Even if you use a fretboard protector round the fret, you can still occasionally get the file sneaking in and doing that. You could mitigate this by rolling the fretboard edges. That would leave much smaller nicks in the board.