By that logic, pretty much every nonessential interaction is a time waste and therefore not ok. Stuttering is not immoral or wrong, so there is no need to think of consideration. People who stutter have every right to speak their minds if they want to.