About configuring NTLM authentication

If a Web server uses HTTP NTLM authentication to restrict access to Web sites, you can specify authentication credentials that enable the Web Crawler to access password-protected pages. The http.auth.ntlm property sets the credentials to be used by the HTTPClient for NTLM authentication.

Note: The Web Crawler only supports Version 1 of the NTLM authentication scheme.
The credentials must be specified in this format:
USERNAME1~~~PASSWORD1~~~HOST1~~~PORT1~~~REALM1~~~DOMAIN1|||USERNAME2~~~...
where: Note that the triple-tilde delimiter (~~~) must be used to separate the values.