You can control a crawler's site capture process by implementing methods and interfaces of the BaseConfigurator class.
BaseConfigurator
Topic:
Coding the Crawler Configuration File
Scripting on this page enhances content navigation, but does not change the content in any way.