Not sure how fretboard brittleness would lead to more refrets, but I can see where it could be a problem during the refretting process. But I'm not sure if it would really be that much different from ebony or maple in that respect, especially ebony.
Just enjoy it, I think they're just jealous!
