Desynching without AI?

Does anyone out there have a confirmed instance of desynching in a multiplayer game with no AI factions or pirates in it?  I can play single player great, and have had success in multiplayer games with the pirates off, but every multiplayer game I try to play with the pirates enabled, the game desynchs.  Is this other people's experience as well?

Just wondering if we have a counter example to my hypothesis, of players desynching with no AI.