About Content Crawler DocFetch
The IDK's DocFetch mechanism is one way for a content crawler
to retrieve files that are not accessible via a public URL.
If a content crawler implements DocFetch, the IDK manages the process
of creating temporary files for indexing and click-through. DocFetch
also allows you to implement user-level access control. You can pass
user preferences or User Information to the content crawler, and this
information can be used by DocFetch to authenticate with the back-end
system or limit access to specific users.
Note: DocFetch does not allow
you to use multiple methods of authentication or implement custom
error handling. If you cannot use public URLs and are not using
DocFetch, you must implement a custom document fetching mechanism
(i.e., servlet or aspx page). If necessary, you can implement separate
servlets for indexing and click-through.
For detailed instructions, see Implementing Content Crawler DocFetch.
