| Google is tough to trick. Bu what if you wanted | | | | generated. This problem can be avoided by |
| to trick it? Well, even if you could trick it, this | | | | including an index page that provides direct links to |
| would probably be unwise, because your site could | | | | pages that have convoluted navigation paths. |
| end up in the "Trash Pile" list. This largely frees | | | | Pages may also be left out if they are not |
| webmasters from spending time on tricks and | | | | available when search crawlers visit. Many sites do |
| page hacks designed to get higher rankings. | | | | periodic maintenance at off hours, or cycle |
| There are several reasons your pages may not | | | | servers during the night. If your site is not fully |
| show up,including the way they are generated, | | | | redundant, it may be unavailable at these times, |
| their availability, and content. | | | | which can result in your site being left out of the |
| According to information at Google's site, they | | | | index. This will normally be corrected the next |
| limit the number of dynamically generated pages | | | | time the crawler visits your site, but should be |
| that they index at any site. Site crawlers can | | | | avoided because it makes it difficult for users to |
| generate a tremendous amount of site traffic in a | | | | find your site. |
| short amount of time. Google limits the number of | | | | In rare cases, page content can cause your |
| dynamic pages it requests to avoid monopolizing a | | | | pages to be left out. If Google identifies elements |
| server's resources. | | | | on your pages that it thinks are inappropriate for |
| Frames can also cause problems. This is because | | | | general audiences, the pages will get filtered out. |
| it's difficult for an automated system to know | | | | The content will be indexed, but may not show |
| what should be indexed: the frame, the individual | | | | up in search results, depending on the searcher's |
| panes, the entire page or the alternate content. If | | | | SafeSearch settings. |
| your site uses frames, it's very important that | | | | Pages are also filtered out if they do not meet |
| your frames include "noframes" content. This is | | | | Google's "quality standards". Google doesn't detail |
| alternate content for browsers that can't handle | | | | what its quality standards are, but things like page |
| frames. It is also used by search engines. | | | | cloaking, invisible text, or other techniques |
| If your site doesn't provide an internal path to all | | | | designed to fool search engines can cause pages |
| of your pages, search robots may not find them. | | | | to be excluded. Pages are also occasionally |
| These pages may also not be indexed if they are | | | | excluded for copyright reasons, or because the |
| only linked to by pages that are not in the index | | | | page content is inflammatory. Fortunately, it's rare |
| for other reasons, such as being dynamically | | | | for any of these problems to affect typical sites. |