The not-so beautiful Googlebot seems to have more issues than anybody could imagine. I’ve just noticed that Google’s crawler got caught in a loop on one of my sites and ended up hitting the sites pretty hard. So I guess I am one of the less than .01% which have problems with a regular WordPress installation. Well…I heard better excuses…here it is:
1170 66.249.67.41
2654 69.202.83.39
host 66.249.66.167
Name: crawl-66-249-66-167.googlebot.com
Address: 66.249.66.167
Now Google has to stay outside