I'm skeptical of what you say. I think that if you have a good technique, using your pinky won't make you any faster.
And you say hold the pick with your first and second fingers. I don't see the point in that either unless it's the way you've learn't to play. However I can't see you having a very good
picking technique without using your thumb.
If you are going to hybrid pick, wouldn't it be more sensible to hold the pick "normally" and use your middle to tap and your ring to pick ala
Zakk Wylde?