Quite usually, particularly with substantial dynamically pushed or user-created web sites, you may possibly really feel you have some indexing complications, i.e. Google does not look to dig your web site as deep as you want it to. The therapies to this may possibly fluctuate but right here are some critical basics you may well want to look into:
- Make certain you genuinely have indexing complications. For some explanation, in numerous situations, Google website: operator will not demonstrate you the serious range how many URLs the look for motor has indexed. You must completely discover how deep your internet site has been indexed in truth ahead of arriving at any conclusions. In this article are some guidelines to do that (also mentioned at SEOmoz):
- check out how many webpages are indexed in every single directory (or subdirectory: the further you dig, the much more precise the outcomes are): internet site:yoursite.com/subdirectory/sub-subdirectory1 + site:yoursite.com/subdirectory/sub-subdirectory2, and so forth.
- lookup for subdirectory-precise keywords and phrases: internet site:yoursite.com inurl:subdirectory (or web page:yoursite.com intitle:subdirectory)
- check out not long ago indexed internet pages (take edge of “date range” option via state-of-the-art look for).
Getting selected any of these methods, very carefully accumulate the knowledge and in the stop you will get a much more accurate quantity of site indexed internet pages.
- Check out to establish any non-indexing styles. Which kind(s) of pages or subdirectories are remaining out without the need of notice: test to type out any non-indexing regulations or logic? By executing this you will be in a position to establish the difficulties that ought to have prompted the indexing issues: duplicate content most likely or incorrect interior architecture. Test to attract your web-site primary interlinking construction and uncover pages that get insufficient connection juice.
- Perform on your site external deep linking ratio: deep backlink to your subdirectories from external sources (high quality deep linking directories ought to even now assistance with that).
- Thoughts your site crawl rate: like I explained in my article on improving crawl price, Googlebot “works on a budget”: if you preserve it occupied crawling massive information or waiting around for your website page to load or pursuing copy articles URLs, you may possibly be lacking the opportunity to show it your other pages.