Skip to main content

Interpreting Crawler Tool Reports

Lesson 12 from: SEO Fundamentals: The Ultimate Framework

Cleo Kirkland

Interpreting Crawler Tool Reports

Lesson 12 from: SEO Fundamentals: The Ultimate Framework

Cleo Kirkland

buy this class


Sale Ends Soon!

starting under


Unlock this classplus 2200+ more >

Lesson Info

12. Interpreting Crawler Tool Reports


Class Trailer

Chapter 1: Introduction


Intro- Course Overview


Chapter 2: SEO 101


What is a Search Engine, and how do they work


What Kind of Work do SEO Practitioners Do


Popular Tools for SEO


The Evolution of Google's Algo


Quiz: Chapter 2: SEO 101

Chapter 3: Technical Analysis


Analysis Introduction


Reporting your Findings


Checking Google's Index


Checking Google Search Console


Setting up Crawler Tools


Interpreting Crawler Tool Reports


Interpreting Page Speed Tool Reports


Checking Schema Markup


Quiz: Chapter 3: Technical Analysis

Chapter 4: Content Audit


Content Audit - Introduction


Basic Keyword Research


How to Determine What Type of Content You Should Create


Qualitative Content Audit


How to Take Your Content Inventory


Reviewing site Architecture


Keyword Optimization


Keyword Gap Analysis


Keyword Opportunity Sizing


Quiz: Chapter 4: Content Audit

Chapter 5: Link Audit


Competitive Link Audit


How to Find Short Term Opportunities


How to Check if a Domain Link is High Quality


The -Oops Something Happened- Audit


Quiz: Chapter 5: Link Audit

Chapter 6: Outreach


Finding Great Contributors on Fiverr


Finding Great Contributors with Ahrefs


Finding Contact Info using NinjaOutreach


Sending Emails Through NinjaOutreach


Quiz: Chapter 6: Outreach

Chapter 7: Project Management


SEO Project Management - Introduction


Wireframing and Product Specs


Reporting on the progress of your work using Asana


A word on Weekly-Monthly Reporting


Reporting Your SEO Impact


Top Tips for Project Managers


Quiz: Chapter 7: Project Management

Final Quiz


Final Quiz

Lesson Info

Interpreting Crawler Tool Reports

and here we are. Here are the results. And I love sight balls so much because it makes it really easy to understand what's wrong with your site at a glance. And the first thing that catches my mind is these hints here and we have 69 hints. These are basically problems categorized. So here are all of our canonical tag problems. You can see we have €1500 s that are pointing to an external your L and site paul says we have four canonical problem. Three of them are advisory. So that means they're not that bad and one is issues. So they're saying that this issue is usually more important than this issue. Think about that when you're putting all this information to your spreadsheet, because you can also get a description of each issue. Um, you can click here to find a suggestion to hint to fix each issue and then we can click in and see the issues. So we see examples of those issues and we can send the engineering team an example to the issues from here. And you can filter and you're going t...

o go through this list and find patterns. Um, and it's just a really nice interface to do this and I'll go through the entire list of hits. Um, starting with the issues and find the patterns that are causing those problems. Report that all in the Ceo's research spreadsheet and prioritize them of course by importance and importance in this case. We look through this list. What are some of the problems, the issues that have a whole bunch of you or else? So this one has a lot and have had recent changes. So you know, maybe something spiked recently and that's going to cause ranking problems down the road and that might be why it's the number one important thing that month or that week or it just might be overall euros that effects in this case. I think one of the the worst problems you can have is duplicate title tags um because that's one of your strongest, your title tags. One of your strongest on page factors that google looks at. So the last thing you want to do is have the same tag and google to be confused on which page they should rank for these keywords and you'll see here this pattern and it's the air pattern and you can go through and filter and find more patterns and here we can export this list and um we can export all these technical duplicates. Makes it really nice for you to do that. And this is also part of the reason why I mentioned that you should export your errors and everything from here versus search council because that allows you to just put everything in one spreadsheet with the same columns rather than trying to match up google search columns with this because you're gonna use this to ask your engineering team to clean up duplicate titles. Technical duplicates. So just one spreadsheet for all of your, you're all by your l requests from your different teams from your content and your development team and yes, and you can go through that list and we'll go back to the dashboard for that audit. Alright, summary of hints and the next thing that you'll notice here is the number of crawled your else that is encountered. It's got around 50,000. And if you'll remember from when we checked Google's index, we have over €200,000 index. So why this difference? And we're gonna have to figure that out by going back to Google's index typing in some of the US and seeing if there are other euro patterns not crawled here that we could see that are indexed in google. So you'll remove different folders until you figure out what's index that's not crawled. And there might be many different reasons why you'd have such a big index. Maybe google has indexed all of our duplicate content, That's a bad thing. Or maybe those are all pages that we do want to index. But for whatever reason, Site Bulb, which is emulating Google crawling our site can only discover €50,000. So that is a different kind of problem where we probably want to increase the amount of eur RLS we crawl each week. And so you'll do things like internal linking to these pages that are orphaned and add more links to the homepage or change your folder structure and you can track how that changes week over week and that's what this next metric is here. So since the last time I crawled, which was earlier today and I stopped that crawl prematurely. Here's how many new euros that we've discovered. So if that's one of the problems, if crawl optimization is one of your problems, if you have a big index and you have a small amount of euros crawled, you're going to track this metric week over week. Um, you can see internal murals that were crawled versus external and then resources. A word on resources. I specifically for this crawl blocked Seiple from crawling them. They usually make your entire crawl like two or three more hours longer. If you have a big site like this, you can also see how long the crawl took here and then they have your, your hints and categories of importance. So there's issue hints, advisory hints here and then here are all the hints that our site passed. So here all the tests are site past and this tracks week over week. I love this view here too. So this is a graphical representation of your site architecture And so that how many clicks it takes Google starting from zero the homepage To discover your content. So you want this green area curve to be mostly between zero and 4. Um, so within four clicks they've discovered your most important pages. You don't want them to spend time clicking through a whole bunch of pages that don't mean anything. These are probably the technical duplicates Only to discover your most important content again, way over here 20 clicks later. So you really want to avoid that kind of stuff and this kind of tells you how you're doing and you can track this over time as well. Um then the next thing that also relates to site architecture is the chrome app and I love the crawl map because it's really how google sees your website, see that green dot, that's the homepage and you see the other green dots. Those are important folders, those and then all the lines there, they are actually links and what you should see is that the most amount of the bigger the circle, the more amount of links they have and you want this to look really like a spider web with your most important page is getting the most amount of links. And then those pages linking out to other important pages which link out to other important pages and your link equity should be like, concentrated more heavily around the middle. That's the the subject matter that you really want to rank for. And that's another way to look at your side architecture. And what you don't want is these kind of splintered off roving up and down and across kind of links because these are probably if you could hover you can see that, that's part there. It gives you, it shows you what page this is. That's part of that error there. So we're creating a whole bunch of fake pages that google has to kind of go through and they're not getting the meat of our content, which is over here. And so that gives you another view in google over time, you want this to look more like a spider web, and that's how I use site bulb.

Class Materials

Bonus Materials with Purchase

SEO Research Spreadsheet