The following configuration parameter applies to content crawlers.
Parameter | Description | |||
---|---|---|---|---|
MaxWebCrawlRadius | The setting for the maximum number of links away from the target page that you want to crawl. For example, if you select 1, the content crawler attempts to import every page directly linked to the target page; if you select 2, the content crawler attempts to import every page directly linked to the target page, and every page directly linked to those linked pages. This setting corresponds to the Crawl Radius drop-down list in the Web Content Crawler Editor. The default maximum is 4, which means the drop-down list allows a crawl radius of 1 to 4. |