You can feel completely justified that someone else is holding you back. You can get support for this idea from friends, media, social conditioning. Yet, no one else can hold you back unless you give them that ability, which means you are the one holding you back. You can change, so this is great news.