Stuttering happens when the vocal folds close abnormally. When whispering, you are not vibrating the vocal folds, thus they have no reason to close. Since they are not closing, stuttering is not an issue