I can't say for sure but when I've taken stimulants recreationally it actually improved my fluency a lot. So your mileage may vary, I wouldn't necessarily recommend testing it out on your own but I feel like trying to medicate yourself for ADHD and then weaning back off if needed under the guidance of your doctor wouldn't be a bad idea. It seems really weird to me that your doctor would outright refuse.