You do not need to apologise but I find if you say sorry they will realise that you know you are stuttering and they will most likely say “no worries” or “take your time” and that helps.