Another client suggestion in action!
Want to just crawl your home page and the pages directly accessible from that page?
You can now do that using the Click Depth Limit field.
For this example, set the Begin crawl at URL field to your home page URL and the Click Depth Limit field to 1. The crawler will start at the home page and inventory all pages within the same root domain that have links on the home page.
Learn more about Site Crawler Options.
If you have questions, please reach out to our DubBot Support team via email at help@dubbot.com or via the blue chat bubble in the lower right corner of your screen. We are here to help!

