Some people tend to shake hands with my fingers instead of my whole hand. Why?

Am I the problem or is it the nuffies of the world that don't know when to grip? It's an embarrment because they must think I'm week and can't offer a good handshake. Makes me want to punch 'em for putting me through that.