I believe it’s more about an assertion problem than it is a speech problem. Your unconscious habit of holding yourself back when around others is a part of the defence mechanism that includes the outwardly symptom which is the stuttering. Face it and recognize it for what it is without fighting it. Show empathy towards it and it will gradually wither away.