Can you talk to HR or someone higher up? This could be a lawsuit waiting to happen. Although you are male harassment is still harassment and something CAN and SHOULD be done. Start documenting all of it from now on. From the conversations with your boss to the interactions with the harassers. The more shit you have on them, the better luck you'll have building a case against them. Try searching for help groups for example try NOMAS (national organization for men against sexism. You could also try RAINN. DO NOT LET THAT STOP YOU. What you are experiencing is a problem and YOU can stop it. YOU have to fight back.