Did you ever get your stutter analyzed by a speech therapist? From your take on it, it doesn't sound like there's a clear pattern to it (in terms of your reactions and incidents), so perhaps there's something you can improve in general.