As a Noahide can I attend a church service with my family? Or is it forbidden?

I want to go to church with my family but from what I’ve heard it is idolatry. Is there any way that I can attend? It’s a non denominational church that is very modern. I want to be able to attend with my family.