whether sinful/bad or not.all she is saying is you can steal and when you are caught and asked why you stole you tell the police "i was born this way" . Another perceptive is that she is telling people not to judge others because all humans have flaws and they were born that way. So tell what you think is the real concept of the song.
