Feeling lost after years of hardship: Is prayer enough?

Assalamu alaikum. I embraced Islam about three years ago, and ever since, life has been one test after another. I had to leave school, a potential marriage fell through due to religious commitments, finding steady work has been a struggle, and there have been many other challenges. For most of this time, I kept up with my prayers and tried hard to stay strong in faith. Lately though, everything feels too heavy. I've even had thoughts of leaving Islam, not because I want to, but because I feel like I'm not worthy of being Muslim, and sometimes I truly feel like Allah has left me. I'm wondering: after years of nonstop difficulty, is it normal to feel abandoned by Allah? And is prayer really enough on its own? When I talk to imams or fellow Muslims, the advice is usually "just pray, trust Allah, and leave it to Him." I know prayer and trust are crucial, but after three years of struggle, I don't know what else I'm supposed to do. Should I be doing other things along with prayer? Am I missing something about how we're supposed to handle long-term hardship? What scares me the most is that I often feel completely numb during prayer. I don't feel close to Allah like I think I should. Sometimes I pray and feel nothing. Does that mean my faith is weak, or can you still have faith while feeling spiritually exhausted and numb? I'm not expecting a life without tests, and I know being Muslim doesn't mean everything will be easy. I just don't understand what to do when hardship seems never-ending and prayer doesn't seem to change my situation or how I feel inside. I feel lost and I really want to know what Islam expects from someone in my situation beyond just being told to pray more.