People around you accusing you acted is probably what brought back the anxiety and destroyed your recently gained confidence, and therefore started making you stutter again. Not the stopping of vitamin B pills.