Using the Robot Utilities

The robot includes two debugging tools or utilities:

• Site Probe – Checks for DNS aliases, server redirects, virtual servers, and the like.

• Simulator – Performs a partial simulation of robot filtering on a URL. The simulator indicates whether sites you listed would be accepted by the robot.