DubBot Staff

For those using SpringShare's LibGuides, here is a guide to maximum efficiency when running crawls on those pages:

Crawls are NOT allowed between 8am - 8pm ET Monday through Friday. (Crawls can be run anytime during weekend)

Maximum 1 connection to our server (<b>Note: </b>No distributed crawling);

1. Crawls are NOT allowed between 8am - 8pm ET Monday through Friday. (Crawls can be run anytime during weekend)
2. Maximum 1 connection to our server (<b>Note: </b>No distributed crawling);
3. No more than 10 requests per second.

<a href="https://help.dubbot.com/en/articles/6405910-removing-accessibility-checks">Removing Accessibility Checks</a>

<a href="https://help.dubbot.com/en/articles/6007939-resolving-an-issue-versus-ignoring-an-issue">Resolving an Issue versus Ignoring an Issue</a>

<a href="https://help.dubbot.com/en/articles/5952665-why-is-my-dubbot-site-indexing-urls-outside-of-our-group-or-domain">Why is my DubBot site indexing URLs outside of our Page Set or domain?</a>

<a href="https://help.dubbot.com/en/articles/5905953-what-is-readability-why-does-it-matter">What is Readability? Why does it matter?</a>

<a href="https://help.dubbot.com/en/articles/4708329-issue-not-found-in-current-view">Issue not found in current view</a>

<a href="https://help.dubbot.com/en/articles/4257010-color-coding-for-scores">Color coding for scores</a>

<a href="https://help.dubbot.com/en/articles/4222940-issue-not-highlighting-on-the-webpage-when-selected">Issue not highlighting on the webpage when selected?</a>

<a href="https://help.dubbot.com/en/articles/4202209-what-is-crawling">What is crawling?</a>

- <a href="https://help.dubbot.com/en/articles/6405910-removing-accessibility-checks">Removing Accessibility Checks</a>
- <a href="https://help.dubbot.com/en/articles/6007939-resolving-an-issue-versus-ignoring-an-issue">Resolving an Issue versus Ignoring an Issue</a>
- <a href="https://help.dubbot.com/en/articles/5952665-why-is-my-dubbot-site-indexing-urls-outside-of-our-group-or-domain">Why is my DubBot site indexing URLs outside of our Page Set or domain?</a>
- <a href="https://help.dubbot.com/en/articles/5905953-what-is-readability-why-does-it-matter">What is Readability? Why does it matter?</a>
- <a href="https://help.dubbot.com/en/articles/4708329-issue-not-found-in-current-view">Issue not found in current view</a>
- <a href="https://help.dubbot.com/en/articles/4257010-color-coding-for-scores">Color coding for scores</a>
- <a href="https://help.dubbot.com/en/articles/4222940-issue-not-highlighting-on-the-webpage-when-selected">Issue not highlighting on the webpage when selected?</a>
- <a href="https://help.dubbot.com/en/articles/4202209-what-is-crawling">What is crawling?</a>

More Frequently Asked Questions