Do you feel nervous/anxious while speaking at these events? If you do, the anxiety might be tiring out your nervous system. If you don't feel anxious, it might be what you referred to as weak nervous system or some other physiological issue. In that case its better to get yourself checked out by a specialist.