You'd be surprised how little people listen to you. As stutterers, we're often hypercritical of every bit of our speech. No one else listens with 1/100th of that attention to detail when we speak. I promise you... They will hear the D even if you don't make the sound.