It might be hard to deal it by yourself, but you can face your fears. Dare to say your opinion, be not comfortable and be different. You are unique, with your unique character traits, point of views, feelings ect.
People who like you and value you, will stay, others naturally will avoid and leave or Allah SWT naturally will remove them from your life.
Remember, people who surrounded you now meant to be here and now for you and you for them. But not necessary they will be tomorrow. As we all changing and moving forward, want we or not.