If you were able to trace it back, I bet all those sounds were the first sounds in “uncgangeable”words you had to say semi-regularly - names of (people, places, interests, toys etc), identifying info like town, address, phone number. Unless you have an articulation issue, then it’s not that the letter is difficult to say - it’s that your subconscious brain associated fear/block/difficult to it