allBlogsList

Sitecore Fun Fact Exclude Robots

When your Google Analytics or Google AdWords are not working correctly on your fresh launched Sitecore site, you may want to refer to this little nugget of information:

https://support.google.com/webmasters/answer/1061943?hl=en

The primary focal point is the user agent column. You may have already exercised the use of the robot meta tag or the robots.txt file, but there is one more place to check…

In your Sitecore.Analytics.Exclude.Robots.config file within the excludedUserAgents tag, you will find a plethora of user agents listed. Match the user agent from Google to the user agent in the list and remove it from the list.

You should be able to have Google crawl your site.