If I recall correctly, you also need to clear all of the other treasure sites in that wildland before it will clear. Thus, if there are any Shattered Statues, Ancient Battlefields, or anything else like that, you need to collect the treasure from those before the wildland will clear, even though they aren't pits or caves and don't have any opponents keeping you from clearing them.
