How to better use your crawl budget

Unlike Black Hat, White Hat cloaking carries no risk of a Google penalty.

One of the benefits of white hat marketing is that it helps reconcile UX designers and SEO specialists. Link cloaking helps resolve conflicts between these two professions.

Basically, the question of whether you link because it’s good for SEO or UX no longer arises, because with link cloaking, you make the links you want for Google and the links you want for users.

Patrick advises starting with log analysis

then removing URLs that are not relevant for SEO.

Obviously, it’s better for Google to see your HTML buy bulk sms service pages rather than JavaScript or CSS files.

Patrick recommends cloaking (or redirecting) automatically generated JS or CSS files. This is the case with Magento or WordPress, for example, which compress JS or CSS to create a cached or versioned file. You will then have a new version of the JS file every day, and Google will continue to crawl it, which can take up half of the crawl budget. These elements should therefore be blocked.

How to increase your crawl budget?

To answer this question, Patrick begins by talking to us about semantic shift.

In the graphs below, each circle represents an HTML support for “impostorism” in the press and society page on the site. The larger the circle, the more internal Page Rank it stores. Each color corresponds to a semantic cluster (a large family of lexical fields).

We can see that the circle on the right is much more orderly:

Content clusters are grouped together;

  • The circles are more uniform in size (the Page Rank is better distributed);
  • The home page has grown;
  • We no longer have any unnecessary details (contact page and general terms and conditions, for example).

The idea Patrick insists on is that each page that clean email talks about a subject should link to pages that are thematically close.

This allows you to increase your crawl budget, because if Google sees that you have relevant links, which point to other pages that enrich the information, it will judge your site to be coherent and will come to crawl it more than less well organized sites.

Patrick agrees with Olivier Andrieu when he says that content is king, the link is its queen, and semantic
content is emperor !

 

Leave a Comment

Your email address will not be published. Required fields are marked *