To learn about content crawlers and content Web services, click here.
To specify the location you want to crawl and the destination folder and security for documents imported by this content crawler:
In the URL to crawl box, type the URL to the site from which you want to import content.
In the Crawl radius drop-down list, specify the maximum number of links away from the target page that you want to crawl. For example, if you select 1, this content crawler attempts to import every page directly linked to the target page; if you select 2, this content crawler attempts to import every page directly linked to the target page, and every page directly linked to those linked pages.
By default, this content crawler creates a link to the URL you entered in step 1. If you do not want to create a link to this page, clear the Import the target page check box. For example, if you crawl the results of a search, you would not want to import the target page (the search results page); you would want to import each linked page (each result).
Specify into which folders you want to import content. The content crawler attempts to import a link to every document it finds into the most subordinate subfolder within the destination folder that allows the link to pass. Click here for a flow chart showing how the content crawler determines into which folders it will import content.
To add destination folders, click Add Folder;
then, in the Choose Folders dialog box, select the folders you want to
add and click OK. To crawl documents
into a folder, you must have at least Edit access
to that folder.
To remove a folder, select the folder and
click .
To select or clear all of the folder check boxes, select or clear the box to the left of Folder Path.
To toggle the order in which the folders are
sorted, click Folder Path. The
icon to the right of Folder Path signifies
the current alphabetical sort order: ascending () or descending
(
).
To require that documents pass the filters of destination folders before the documents are imported into those folders, select Apply Filter of Destination Folder. By default, documents do not need to pass the filters of destination folders, so all documents will be imported into all destination folders.
To accept all imported documents into the portal and make them immediately available to users, select Automatically approve imported documents. By default, documents require approval. This means that before the link to the imported document is available to users, it must be approved by a portal administrator with at least Edit access to the destination folder.
Under Document Access Privileges, you can perform the following actions to grant users and groups access to the content imported by this content crawler:
To add users or groups, click Add Users/Groups;
then, in the Choose Groups and Users dialog box, select the users and
groups you want to add and click OK.
To add a user or group, you must have at least Select access
to that user or group.
For each user or group, in the associated Privilege drop-down list, choose the access privilege you want to grant for content imported by this crawler.
To remove a user or group, select the user
or group and click .
To select or clear all of the user and group check boxes, select or clear the box to the left of Users/Groups.
To toggle the order in which the users and
groups are sorted, click Users/Groups
or click the icon to the right
of that— (sort ascending, a-z) or
(sort
descending, z-a).
To view the members of a group, click the group name.
To display the page associated with this help topic: