Don't really have advice on the stuttering but I can say from personal experience that 24 at uni doesn't feel that old and there are many more older people at mine. Also, my brother started at 28 and dad started at 40. It's never too late.