Stop being afraid to lose people who do nothing for your life.