The way my speech therapy went was we would practice breathing exercises and practice speaking fluently. I never worried about removing the things I did to help me speak more fluently. Maybe looking away from people is one you should try to get rid of but I don't see anything bad with adding "umm" whenever you feel like you are gonna stutter. I still do that a lot and other people don't mind as well. You might want to ask your therapist what your path and end goals are together as you might not be on the same page as to what you are trying to accomplish