DubBot recommends that when site crawls are set up, that they are done in smaller sites, as opposed to crawling your entire site. The biggest advantage is that it allows clients the flexibility to perform faster re-crawls, as opposed to waiting for the whole site to be re-crawled.

Smaller sites can also give users more fine-tuned access to 'their' part of the larger site.

Also, smaller sites are simply easier to consume. DubBot provides a lot of useful information. Breaking the reports up into smaller chunks allows clients to more easily identify and process the higher priority issues.

In order to break your account up into smaller sites, set up DubBot sites that start one level deeper in the folder structure. For example, to set up a DubBot site for your Blog, base the crawl on:
​https://example.com/blog 

Of course, DubBot Support is available to consult directly with you to determine what the best practice will be for configuring your site(s) within DubBot.
​
​
​