I'd just tape off the (edit) fretboard either side of the frets and go at it with steel wool.
Life is too short.
cheers, Mark.