HTML-only pages are generally easy for a web spider to parse, but on pages that use Flash or JavaScript, a spider may have difficulty finding links to other pages. As a result, search engines may give those pages low rankings.

You can often improve the ranking of your site pages by using sitemaps to help spiders find the pages. Sitemaps are files stored on a web server that list the URLs of the site pages, so web spiders are able to identify site content without relying exclusively on their ability to crawl and parse the pages. Sitemaps are not an official standard, but they are supported by many search engines, including Google, Yahoo!, and MSN.

This section includes the following: