That's a hard one. I'd say it's possible to enjoy things and have them not be good for us. Have a think about weather it's a net positive for you or a net negative and make a decision from there. You can always take a break without giving up completely too and see if you feel better overall. Or work on the ocd and stress separately. I know I have to constantly work at reducing anxiety and be conscious of secondry movements when I stutter.