Once you've logged in for multiplayer, open the overlay via Shift+Tab and click Friends. That will open a IM-like list with anyone you've added, so you can double-click to open a chat with them. There is also the Chat option which goes to a public chatroom.
