Back to All2018-01-05 January 5th, 2018 by Jerome Choo Crawlbot API: Added the useCanonical argument to allow disabling of canonical URL deduplication on specific crawls.