Googlebot, puttying and tailing logs
Ah the GoogleBot. Googlebot is Google’s web-crawling robot. Its job is to go out into the great Internet unknown and collect documents to build a searchable index for the Google search engine. In order for a site to be listed on Google’s homepage and be available for searching, that site must first be indexed by the GoogleBot.
I don’t know what other site operators do, but we tend to putty into the server and tail the access logs quite a bit. Yeah, yeah… it’s pretty sad but can’t help but get a kick whenever we see a “real” user access our sites… 
Where is that GoogleBot?
Dave said,
November 13, 2005 @ 5:06 pm
I’m surprised you still tail your access logs by hand - I would have thought that you would have a script that did that, filter out the bots/spiders out there and SMS you when you had a live user hit
dave said,
November 14, 2005 @ 3:19 pm
Hehe Dave - yes, we do have some nice scripts but nothing beats tailing a log file and seeing a new entry come in…