[/map {"- map/map "}) [/map/topicref {"- map/topicref "}) [/map/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicmeta/navtitle {"- topic/navtitle "}) Introduction (navtitle][/map/topicref/topicmeta/linktext {"- map/linktext "}) Introduction (linktext][/map/topicref/topicmeta/shortdesc {"- map/shortdesc "}) This section provides introductory information about the Endeca Web Crawler. (shortdesc] (topicmeta][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Web Crawler overview (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Web Crawler overview (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The Endeca Web Crawler is installed by default as part of the IAS installation.The Web Crawler gathers source data by crawling HTTP and HTTPS Web sites and writes the data in a format that is accessible to Endeca Information Discovery Integrator (either XML or a Record Store instance). (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Running a sample Web crawl of oracle.com (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Running a sample Web crawl of oracle.com (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can examine the configuration and operation of the Web Crawler by running a sample Web crawl.The sample is located in the <install path>\IAS\workspace\conf\web-crawler\polite-crawl directory. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Running a sample Web crawl that writes to a Record Store (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Running a sample Web crawl that writes to a Record Store (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) In this topic, you run a sample Web crawl that writes output to a Record Store instance instead of to a file on disk.This sample is stored in <install path>\IAS\<version>\sample\webcrawler-to-recordstore.The run-sample script runs the sample Web Crawler. (shortdesc] (topicmeta] (topicref] (topicref] (map]