Everything is physical.   There is no separate mental realm. It all originates from the brain.    One person can have your upbringing and not stutter.  Another one does.   Your brain is different.  Sooner you accept that you can accept your stutter.  The psychological stuff just exasperates it.  It doesn't cause it.