I would just focus on that end of the neck for a bit. I've found a couple of my kits had a bit of a 'ski jump' going on at that end. It won't hurt to have them slightly lower. You can take a fair bit of meat off the frets safely, most future fret wear tends to occur in the first 3 frets and then 5-9.