All Collections
Setting Up DubBot
Best Practices: Smaller Sites vs Whole Site
Best Practices: Smaller Sites vs Whole Site
There are big advantages to breaking your websites up into smaller sites, versus doing a single large crawl.
Blaine Herman avatar
Written by Blaine Herman
Updated over a week ago

DubBot recommends that when site crawls are set up, that they are done in smaller sites, as opposed to crawling your entire site. The biggest advantage is that it allows clients the flexibility to perform faster re-crawls, as opposed to waiting for the whole site to be re-crawled.

Further, smaller sites allow clients to set up Groups, which can limit certain users to only seeing reports for certain sites. The idea behind Groups is that clients are likely to have certain users that do not need to see all of the content that is being tested.

Smaller sites are simply easier to consume. DubBot provides a lot of useful information. Breaking the reports up into smaller chunks allows clients to more easily identify and process the higher priority issues.

In order to break your account up into smaller sites, set up DubBot sites that start one level deeper in the folder structure. For example, to set up a DubBot site for your Blog, base the crawl on: 

Of course, DubBot Support is available to consult directly with you to determine what the best practice will be for configuring your site(s) within DubBot.

Did this answer your question?