There are three common contributors to the fear of being alone forever: your past, your self-esteem and your social conditioning. Past abandonment – when the person whose love you craved most as a child abandoned you or acted distant and uncaring – is a big cause of this fear for many adults.