Once a new always a Jew?

Why do jews belive that when a person. Becomes a jew there always a Jew where does this come from?