I can relate a lot to this as well I think, but English has more of these sounds for me than my native language. Also it might be because I mostly speak English when being evaluated at school and in class, so my brain could have started associating English with a stressful situation