I'll put it this way. Losing troops to events that are beyond your control is by far the most annoying aspect of a game, to me.
From disease in Total War games to nukes in Starcraft or Rise of nations.
But, if you guys are fine with it, then sure.
It's not 'beyond your control'; you've got access to spells as well and should be able to counterspell your opponent etc. If anything, what you've said is an argument to improve magic-use by the AI - a case that's been made numerous times on these boards already.