Contents
When you crawl the default zone of a SharePoint Server web application, the query processor automatically maps and returns search-result URLs so that they are relative to the alternate access mapping (AAM) zone from which queries are performed. This makes it possible for users to readily view and open search results.
To crawl user profiles and then crawl SharePoint Server sites Verify that the user account that performs this procedure is an administrator for the Search service application that you want to configure. Follow the instructions in Deploy people search in SharePoint Server.
To limit how much content that you crawl, you can create crawl rules for the following reasons: To avoid crawling irrelevant content by excluding one or more URLs. To crawl links on a URL without crawling the URL itself. This is useful for sites that do not contain relevant content but have links to relevant content.
How does crawling affect the performance of a server?
Crawling content can significantly decrease the performance of the servers that host the content. The effect depends on whether the host servers have sufficient resources (especially CPU and RAM) to handle the load. Therefore, when you plan crawl schedules, consider the following best practices:
How does search service work in SharePoint Server?
When you create a Search service application, the search system automatically creates and configures one content source, which is named Local SharePoint sites. This preconfigured content source is for crawling user profiles, and for crawling all SharePoint Server sites in the web applications with which the Search service application is associated.
Can you set crawler impact rules for external servers?
For servers in your organization, you can set crawler impact rules based on known server performance and capacity. However, this might not be possible for external sites. Therefore, you might unintentionally use too many resources on external servers by requesting too much content or requesting content too frequently.