For those using SpringShare's LibGuides, here is a guide to maximum efficiency when running crawls on those pages:
Crawls are NOT allowed between 8am - 8pm ET Monday through Friday. (Crawls can be run anytime during weekend)
Maximum 1 connection to our server (Note: No distributed crawling)
No more than 10 requests per second.