I have heard that caloric deficits can induce more anxiety in people who are already prone to anxiety. That's why some psychiatrists recommend eating a full breakfast. Also about your medication thing. I personally have noticed that my stutter becomes 20 times worse when I smoke cigarettes. So drugs/meds definitely have an effect.