Hey guys, my temper got the best of me and I'm feeling really guilty about it...

Assalamu alaikum, so it was just me and my mom at home early in the morning. I was still sleeping because I've been exhausted from exams lately, and my mom was up. A man came knocking at the door – he looked healthy and was wearing a cap, and my mom, since she was alone with a male stranger, didn't want to open it and didn't want to wake me. He started ringing the bell over and over, acting kind of odd, and my mom waited hoping he'd leave. But he kept going – by the seventh ring I woke up annoyed and asked my mom what was happening. We checked the CCTV and saw him acting arrogantly, demanding money, then he left but suddenly came back and rang again! At that point it was like the tenth time, and I couldn't stop thinking, what if I wasn't home and it was just my mom and sister? What would they have done? I got really furious, half-asleep, and opened the door to confront him. I asked why he was ringing so much, and he claimed he only rang a few times – that made me even angrier. He said he was a scholar from a mosque, which confused me more. I reminded him that in Islam we're taught to knock three times and then leave if no one answers, but he just ignored me and said he knocked three times... I'd had enough, so I told him firmly to leave and never come back this way, asking what if there were only women inside? He kept denying and repeating himself. He left looking mad, and these days lots of people come collecting money almost like a job, especially with Ramadan starting – they expect more generosity. As he was walking away, he shouted something like something bad will happen (hard to translate exactly). My mom then handed me some money to give him for her sake, but when I went out he didn't hear me calling. Honestly, was I in the wrong here? I feel bad about how I handled it and I'm praying for forgiveness soon, insha'Allah.