I completely relate to this and I think it has entirely to do with subconscious anxiety and unrest; I find that the more I think about the fact that I have a stutter it makes it absolutely worse on certain days( thus I’d suggest trying to avoid mentally dwelling on it), it also gets worse if I just happen to be more stressed or anxious during certain periods of time