Scenario:
I work in an office of 3 females and 2 males (plus me).
Generally I become the whipping boy as I am more busy concentrating on my work rather that retaliating to little jibes so it just goes over my head - but recently I've noticed an aggressive trend from the guy who sits right opposite me. He will make an argument, be it justified or not and then starts bullying the point across - raising his voice and going to the point where it becomes nasty. But he's a fairly cocky guy (despite not being big, hard looking or otherwise hes quite a posh looking young lanky guy who's about 6'1 maybe?) so remains cool. I have an issue which I've realised in these scenarios, I am not a quick witted individual so I can't do the retort route so the only recourse I have available would be to become physically threatening which is really not suitable for an office environment despite how deserved it may be. But I notice despite how calm I try to remain I become very short of breath and frustrated as he continues to push the issue so instantly a sign of me backing down and I just cant avoid this happening.
He is then joined in by the other male and females in the office to make me look like a tit.
Frankly I'd love to give him a smack in the face and teach him a lesson that way but given the boss doesn't really want any bad feelings in the office she wont assert herself, nor defend my position - IN FACT a week ago they both had a proper hammering at the boss making her cry in a very similar manner but she can't afford to lose them so they see themselves as being in a superior position.
What would the males in here do in such circumstances? I've tried ignoring but it's occurring on a daily basis.