I would open up a little and ask for specific constructive feedback and they can't fault you for trying to get better. Bring it up too "are my interview skills regarding my speech hindering me as a candidate?" It will sting but it will be a sting you're expecting and you'll know what to work on. Keep your chin up, things will get better but you gotta ask for the feedback.