Cannot get an alliance - bug or I am doing something wrong?

I have Close relations with a couple of other civs but the option to make an alliance does not show up in diplomacy? I have made an alliance with one civ, but I cannot with the others even though relations are great (close status). Does each of the two civs need to have the technology "Alliances" to be able to make an alliance?

Thanks in advance for the help!