As an example, I have an Earth shard near to my city. Improvements have been built close enough to it that the shard is now encircled within the city's fence (wall?). As a result, I can no longer click on it to get the info box. The same happened with an ancient temple.