A Seeker's Question: Visiting a Mosque

Assalamu alaikum, friends. I’m currently learning about Islam and, as someone from a Hindu background, I’ve been trying to perform salah-though not all five times regularly just yet. Lately, I’ve felt a strong desire to visit a mosque. Is it permissible for someone like me to come and pray there?