Free Will, Culpability, and Tinok Shenishba

Are we responsible for what we are? A tinok shenishba (and likewise a secular Jew) is not responsible for what they are, as they were only acting in accordance with what they were taught. I presume someone who grew up in 1930s Germany and thus took on Nazi beliefs would in fact be responsible for what they are nonetheless. How is this reconciled? What determines the extent to which we are responsible for our beliefs and actions (considering our actions, while still chosen, are determined in many ways by other factors)?

edit: insensitive/inaccurate terminology