My take on your situation is that because of your stutter you have matured into a healthy empathetic individual. The consequence of which had also allowed others to take advantage of that. It’s a difficult thing to navigate.