Never. Even if you're not making any progress by time, always remember that stuttering can be seen as a cute and/or distinctive feature despite the way we feel about it.