Hasidic Men & Working

After researching Ultra-Orthodox Judaism for some time, it’s clear that the women tend to be the breadwinners in most cases and the men’s secular education seems to stop at basic math and linguistics since they’re commanded to dedicate their life to studying Torah. I’m just wondering how this would work in a society where everyone was following the religion to the same degree. It seems like this lifestyle is only feasible when the secular population outnumbers the Ultra-Orthodox and “keeps them afloat” so to speak. Surely Jewish men were out working like normal citizens in the Biblical days. Somebody had to be responsible for farming, military service and other forms of hard labor and I don’t think it was women