Most of that will evaporate or soak in within a few days, but you can try removing it with turpentine, white spirit or methylated spirits and a clean cloth. All of those will evaporate quite quickly but they should thin the oil and get a lot off on the cloth first. I'm not sure which of those is best though.

Lemon oil does make that fretboard look good though.