If getting a new job isn't immediately feasible, maybe try looking for social activities around you that help you to de-stress and gives you the opportunity to meet with people.  Stress definitely makes my stutter worse.  In the past, going to Toastmasters helped me with both de-stressing regarding my speaking ability, and with meeting with people.