You are not alone. I don’t have advice other than try to navigate the best you can. The workplace can be cliquish. It’s the undiplomatic ugliness of the natural human congressional condition. Stuttering can be a benefit or hinderance depending on the quality of people around you. Don’t be down on yourself. You have every right to happiness as everyone else.