You may want to take a good crowning file and putt a little fall off on the last few frets. Stew Mac makes a file for use with the strings on. That would be a good way to just dress the high fret and how much to take off. Your neck relief sounds just fine. The action sounds about right.
Shimming the neck will make the last fret even more problematic. I wouldn’t try that.
Shimming the neck will make the last fret even more problematic. I wouldn’t try that.