Heckled for being Muslim twice in San Diego - need advice, assalamu alaykum

Assalamu alaykum. I’ve traveled a lot for work and vacations with my wife and we’ve only ever been heckled in one place: San Diego. I grew up in the DMV, my wife is from Toronto, and I’ve spent time in New Jersey, New York, LA, Vegas, etc. But the only times we’ve had explicit hate directed at us were in San Diego. For context, my wife wears the hijab. The first time was downtown: a man walked by, made an obscene gesture and shouted “F*** Islam.” We both smiled and didn’t want any confrontation. He kept taunting us with things like “get that Islam sh*t out of here,” trying to provoke me. We figured it was just one guy and not a big deal. Then today at a Target near the sports arena another man walked by and said the same thing, “f*** Islam,” then started praising Jesus and even made a crude comment about Aisha’s age. Again we just smiled and stayed quiet. To Muslims living in San Diego: is this kind of thing common? Is the area usually this Islamophobic? I thought California being so Democratic might mean fewer issues like this, but apparently not. Some extra context about me: I train amateur middleweight MMA as a hobby and passion. I’m not trying to brag, but judging by how mouthy and large these men were, I probably could’ve handled them physically - and they didn’t look like they had experience in fights. Still, as a Muslim I’ve been choosing to stay calm and smile to show we aren’t what they assume. I also worry about weapons and never want to get into a physical fight with my wife present. It seems the only reason they know we’re Muslim is my wife’s hijab. How should I handle this if it happens again? Stay quiet and patient, confront them, or something else? Should we consider moving out of San Diego? Has anyone else dealt with this often, and any advice on keeping safe while standing firm in our faith? Jazakum Allah khair for any input.