Went to work without my hijab and ended up putting it back on two hours later

Assalamu alaikum sisters, I could use some advice and a bit of reassurance. I’m a nurse at a small facility and usually I wear my hijab. Lately I’ve tried going out in public without it and thought I’d be okay going to work without my headscarf. Oh man, I was so wrong. My stomach was in knots the whole commute. When I tried to get into the building I was so nervous I kept typing the wrong door code (in front of a coworker!). I laughed it off and said, “I guess I’m just a little frazzled being without my hijab haha.” My coworker said she understood but seemed a bit awkward about it. At about 1:30 AM I called my husband to bring me a headscarf because I felt exposed and uneasy. I’m embarrassed because my coworkers were puzzled to see me run out to a car in the middle of the night (the nursing station has cameras). My husband was really supportive - both about my choice to try going without it and about my decision to put it back on. I’m making breakfast now and plan to talk more with him about how I’m feeling. A little background: I’m a revert and took my shahada in April this year. I started wearing the hijab right away and I’ve been wrestling with being the kind of Muslim I want to be. I still struggle with praying five times a day, I haven’t quit smoking, and I slip up in other ways. For a while I thought my hijab was the issue. I’m learning that the hijab isn’t the problem - it’s me and my own journey. Any tips from sisters who have gone through similar feelings? How do you balance baby steps with not being too hard on yourself? JazakiAllah khair.