About the Case Study

On a site with 10 million URLs, it can be difficult to get a high-level view of the overall health. When an online auto marketplace used Botify to do just that, crawling their site and comparing it to their log files, they found that Google was missing 99% of the pages on their site. Ouch.

Thankfully, identifying their crawl rate was the first step in a path to recovery, eventually resulting in a 19x increase in Googlebot crawl, leading to doubled weekly organic traffic.

Learn how they did it.