I’m an atheist. Im very interested in Jewish text and have done a little bit of research on Jewish Atheism. I have a simple question.

Can someone of no faith/belief system, walk into a synagogue, and practice Judaism on the intentions of continuing Atheism but with the thought in mind of appreciating the Jewish belief system?