The exact parameters which Google employs to index the all the worlds information on the web is a complete anathema to some business webmasters.

It could be seen as a very complex process to understand Google’s algorithm, in fact it is, however it’s not necessary. Simply by knowing the core basics of how Google crawls you can make better business decisions regarding your website.

Firstly, Google does 2 main types of crawls. We have a ‘deep crawl’ which is done once a month on average. This is where Google goes through websites in their entirety indexing pages. Now this takes a long time even for Google to get through so they cannot simply rely on this type of crawl. The internet changes so quickly that Google would find itself quickly out of date.

Performing a deep crawl takes up to one week for Google to complete but of course it must index all of that information which takes longer again. By the time the full process is complete it can take 6 weeks or more for a new site to be found and indexed if it’s lucky!

For this reason we also have what’s known ‘fresh crawls’ which rather than going deeply into websites it skims the surface quickly picking up new recently added information and updates.

Robots which seek out links and travel quickly from site to site are the mechanics behind fresh crawls. It allows Google to skim the web picking up only the latest updates and keep itself relatively up to date with all the constant changes.

Because of this you’re much more likely to have a new website indexed by Google by using backlinks to your site that by simply submitting your URL and waiting for Google’s deep crawl to find you.

It could take months as opposed to days with a few simple backlinks. Google keeps its fresh crawl schedules secret however by being alert it’s still possible for you to recognize them.

Want to find out more about fishing rod cases, then visit Payo Hernandez’s site on how to build a fishing rod case.

Tagged with: • • • •

Filed under: Search Engine Optimization

Like this post? Subscribe to my RSS feed and get loads more!