Bigger & faster crawling

These articles provide guidance for instances where you want to crawl faster than normal. In general, this tends to coincide with also crawling larger websites.