Something is wrong, definitely. I've had this happen now and again, as so many of us have. First check your wiring connections, everywhere connected to the alternator, especially the battery box and don't forget there is a contact post on the outside of the battery box where the +24V battery cable "leaves" the box for the alternator. It's a two sided post, NOT a cable pass through as in civilian vehicles. Mine was loose on the outside post, and some numbnut used a nut with the wrong thread pattern on one side of the pass through as well.
Also, someone will ask: "Do you have a grounding harness?" so it might as well be me. Checking and cleaning ALL grounds, including those behind the instrument cluster is also a VERY good idea. The supplemental harness is favored by many. Plenty of threads about it here on the site, and some instructions to make your own (I did).
If all that doesn't help, then possibly the regulator is beginning to fail, or just needs a tweak to clear some smudge on the adjustment contacts inside. To give you more advice on the regulator, we need to know what Amperage alternator you have as well as any custom electrical stuff you might have installed. My knowledge is currently limited to the Gen Zero 60A version, though I have a 200A setup being put into my truck now as part of a powertrain swap.
Bulldogger