The robot crawls to the various sites selected for indexing. You control how the robot crawls sites by defining crawling and indexing operational properties.
Select Search Servers from the menu bar, then select a search server.
Click Robot from the menu bar, then Properties.
Specify the robot crawling and indexing attributes as necessary.
For more information about the attributes, see Site Probe in Sun Java System Portal Server 7.1 Technical Reference in Sun Java System Portal Server 7.1 Technical Reference.
Click Save.