Yeah but it's also a term of abuse. "He's such a wanker. **** off you wanker! Ref! Are you ****ing blind, you stupid wanker? That was never a penalty!" and so on...
I find it hilarious that Peggy's family in
Married With Children were actually named the Wankers. Peggy Wanker married Al Bundy. I'm not sure the writers even knew. Or maybe they did, but America didn't.