All Collections
Release Updates
2021
Limit Crawls to an estimated page count and/or site folder depth
Limit Crawls to an estimated page count and/or site folder depth

October 29, 2021

Updated over a week ago

Site Settings now allows administrators to limit Crawls of sites by estimated page count and/or folder depth.

Crawl Depth Limit and Page Limit options will be under the Crawler Type option in the General settings of a Site.

Page Count allows administrators to put in an upper limit for page inventory. This is an estimated count and returned results will likely be less than the page count entered. This difference is due to the post processing that occurs where pages are identified as duplicate pages because paths include extensions or landing page details.

Site folder depth allows administrators to put in a number of folders deep that a crawl should occur. This option is only available for Crawls that utilize the Default and Full Domain crawl setting.

Did this answer your question?