Google blocks browsers
Netmeister has an interesting blurb about experience with Google blocking various UserAgents.

From the posting:

For example, perl's LWP::UserAgent sets the agent string per default to
"libwww-perl/#.#". Google apparently doesn't like that and will not
return results to you. Setting it to something like "Mozilla/5.0 (X11;
U; NetBSD i386; en-US; rv:1.8.1.3)" would work.

Interestingly, they appear to whitelist agents, rather than blacklisting
them.

What was that about not being evil?

[/musings] [permanent link]