Search engine IPs
Last week I was wondering how many of the users on www.mirc.net that was real users and how many was webcrawlers.
I wrote some basic code checking user-agent and IP on everyone connecting to www.mirc.net, added it into a database and now sorting them live. I’ve added known search engine user-agents to a database and if anyone is connecting and is matching that user-agent the IP is sorted in under the correct search engine.
From old experience i knew that Google was indexing us the most, and that Google is the search engine that sends us the most visitors, yet Google has as of today connected with 4 different IPs and Yahoo from 1160 different IPs, why?
You can find the stats here or by clicking the link in the menu to the right.