At this point I'm pretty sure exp is based off stats, and I was trying really hard to play a death mage type character and my only option in low levels is to stack wither while other units attack "safely." It seems like stacking wither reduces exp drastically (or there's something else at play). That wasn't my only 1xp in those games, it was just the one random battle I decided to take a screen of, I was also getting 1s from wolves and bandits.
When I first tested another civ I just went with tarth, started up, killed the first thing I saw solo with irane, was a spider that gave 3xp and I quit without testing further. I started another game later though with a fire/life mage and played for a while and everything went much smoother and I got to level 11 in about the same amount of time it took my death mage to get to level 3. I would still say the very lowest level enemies don't give enough exp, but the higher level enemies might even give too much still, so the scaling is way off anyway.