Botify Blog

Crawl Budget

Google Crawl Budget Optimization
Google Crawl Budget Optimization

SEOs know that optimizing crawl budget for large and complex websites is critical for organic performance. But how can you find your own crawl budget? And once you understand your site’s crawl budget, how can you impact it?

Laura ScottLaura ScottComments0
Quick Wins: Increasing Google Crawl by over 300%
Quick Wins: Increasing Google Crawl by over 300%

JobiJoba’s Enterprise-scale site was a challenge to optimize, but the team had worked hard to boost performance. Over time, Jobijoba could see that Googlebot was crawling fewer and fewer pages per day, and it was negatively impacting their organic traffic. But why? Enter, Botify, and solutions that drove a 300% increase in Google traffic overnight!

ElizabethElizabethComments0
Botify sheds light on Crawl Errors in Google Search Console
20th April 2017
Botify sheds light on Crawl Errors in Google Search Console

In an ideal world, you wouldn’t have Crawl Errors. In reality, web technology is ever changing and people can make mistakes. SEO Log Analysis helps you get perspective on and prioritize solutions for Crawl Errors found in Google Search Console and better use your Crawl Budget for strategic content.

JeffJeffComments0
Expand on Google Search Console Data with Botify
29th March 2017
Expand on Google Search Console Data with Botify

Google Search Console has great data and tools to manage your website’s relationship with Google, from search analytics to sitemaps. But it has its limitations! As part of our ongoing series on Crawl Budget, here's how you can complement GSC crawl reporting with Log Analysis and SEO insights from Botify.

JeffJeffComments0
Crawl Budget is a Finite Resource: Spend It Wisely
Crawl Budget is a Finite Resource: Spend It Wisely

Like any budget, Crawl Budget is a strategic resource to be managed to achieve your goals. Actively monitoring can prevent you from wasting it on pages that aren’t helping you drive more traffic and revenue. You decide what is allowed to be crawled and organize your website to influence Crawl Ratio and Frequency...

JeffJeffComments0
Time Is On Your Side: How To Use Crawl Frequency Metrics For SEO
23rd February 2017
Time Is On Your Side: How To Use Crawl Frequency Metrics For SEO

What is Crawl Frequency? Find out in Part 3 of our series on Google Crawl Budget. Understanding what pages are crawled frequently is a good indicator about what Google thinks is worthwhile, what it needs to keep fresh in the index. Analyzing those pages can inform what you might need to do to improve parts of your site crawled less frequently.

JeffJeffComments0
What is Crawl Ratio, and Why Does it Matter?
What is Crawl Ratio, and Why Does it Matter?

What Is Crawl Ratio For SEO? Crawl Ratio is the percentage of unique URLs in your website structure that have been crawled by a search engine robot. It's uncommon for Google to crawl entire websites within a month’s time (30 days). So how can you determine Crawl Ratio for your website? We explain in Part 2 of our series on Crawl Budget.

JeffJeffComments0
Google Confirms SEOs Should Control Their Crawl Budget
26th January 2017
Google Confirms SEOs Should Control Their Crawl Budget

In Google's latest blog post by Gary Illyes, it was confirmed that Googlebot has limited resources to crawl each site. More importantly, they confirmed that SEOs can and should be optimizing this crawl budget! Learn how to optimize your crawl budget in 2017

JeffJeffComments0
Don't miss a thing

Sign up for our newsletter to receive expert insights and SEO news from Botify.

,
,