Enabled sites crawl on a regular cadence that is provided in the General Site settings. Learn more in the Site Setup article.
By default, this cadence is every 7 days. However, in the Advanced Site settings, it can be updated to be longer than 7 days. Learn more in the Advanced Settings for Sites article.
Disabling a site will disable it for both automated and manual crawls. To crawl the site again, it must be re-enabled by an account admin.
Disabled sites will not show in the All Sites (Page Set) Site List Panel but the pages will show in Page Set reports where the site has been added to the Page Set.
Disabled sites will not have the button to Crawl the Site. A site must be enabled to run a crawl.
If you have questions, please contact our DubBot Support team via email at help@dubbot.com or via the blue chat bubble in the lower right corner of your screen. We are here to help!