Married non Jew before finding out that I’m Jewish.

Help! I ended up marrying someone completely incompatible and now fearing future of my children. I wish I would’ve listened to my parents. Now I’m in the most difficult position with self preservation vs my children growing up without trama.