Sometimes the filler words help maintain your fluency, like word substitutions. Eventually you will rely on them less, but please don't feel bad for doing it.