This really needs to get fixed. If you are trying to walk down a narrow passage between mountain or sea, trying to visit a lair/quest loc/goodie hut that is right up against a mountain, etc; even if you are 1 square away from it, clicking to move there usually causes your army to take a random route trying to go around the mountain somehow.
With all the mountains in the odd locations that they are generated in, it can be more than just annoying