When you click the Sites tab, the Manage Sites page is displayed. This page displays the list of Site Names and the Status of each site (enabled or disabled) that the robot crawls to generate resource descriptions. When you select the checkbox, the Delete, Enable, and Disable buttons become active. Select the Delete button to delete a selected site. You can enable or disable the selected site by clicking the Enable or Disable buttons. A disabled site is not searched when the robot is run.
The table below provides the attributes and their description in the Manage Sites page.
Table 4–2 Manage Sites Attributes
Attribute |
Default Value |
Description |
---|---|---|
Lock or cluster graphic |
Status of site |
Lock open means that the URL is accessible. The closed lock means that the site is a secure web server and uses SSL. The cluster means that the site is a domain. |
Enabled/Disabled |
Enabled |
Choose to search this site or not when the robot is run. |
You can create a new site, by clicking the New button. When you click the New button, the New Robot Site page appears. This page allows you to set up a new Robot site. The table below provides the attributes available in the New Robot Site page and their description.
Table 4–3 New Robot Site Attributes
Attribute |
Default Value |
Description |
---|---|---|
Type |
URL |
Select URL or Domain from the list box. |
Site |
Blank |
If you have selected the Type as URL, enter the URL of the site you want to create. The URL format is: http://www.sesta.com If you have selected the Type as Domain, enter the domain of the site you want to create. The Domain format is: *.sesta.com |
Depth |
10 |
You have a choice of 1 for this URL only, 2 for this URL and first links, 3 - 10, 100 or unlimited. The default value is set in the Robot —> Manage Properties page. |
Destination Database |
Use Internal Default |
Select the database that you want to use from the list box showing the available databases. |
Click on the Site name to navigate to the Edit a Site page. You can use this page to define the search site more completely. You can specify what type of server it is, redefine the depth of the search, and select what type of files to add to the search database. The attributes for URL and Domain sites are mostly the same. The additional column in this table shows which attributes are shared and which are unique.
You can verify the server name for the search site you entered. In the Server Group section, click the New button to add more servers to the server group. In the Starting Points section, click the New button to add more starting points. In the Filter Definition section, you can add or delete, exclude or include certain types of files as well as change the order the filters for these files are applied.
The table below provides the attributes and their description in the Edit a Site page.
Table 4–4 Edit a Site Attributes