Have you checked to make sure that those you visit are on the same server as you? If they are on a different server then it will appear that you have visited when you have not. At the moment it appears you can only get bonuses from visiting those on your own server.

Also many players play on multiple servers so when visiting check what server they are on. One way is to look at the link as it loads, look by their avatar or before clicking visit you can click more and it will show you what server they are currently logged onto.

Hope this helps.