It sounds like you’re losing confidence in your speech and are trying to avoid words by throwing in ‘um’. I don’t think anyone can really comment on the severity of it but if you can, actively try and cut it out