First of all, take a look at your bylaws and CC&Rs. Check what kinds of violations your HOA can fine you for. I’m willing to bet “not attending social events” isn’t one of them. That’s your free will.
Next, take your problem to the board. It would help if you got some support from fellow homeowners, too. Let the board know that what they’re doing is not with keeping in line with your governing documents.
If they still don’t budge and you end up getting fined, sue.
I would say suing should be your last resort. As much as possible, try to settle things out of the courtroom. The HOA gets its money from the homeowners (including you), so suing them would mean that homeowner fees will just be going to legal fees. Essentially, you’re paying for the HOA to defend itself. Suing should be the last option if you can’t make anything else work.