• Significant improvements to Video API site support.

• Custom API fields using the attribute filter will now return all matching selector values, not just the first attribute match.

Crawlbot and Bulk Service data retrieval no longer requires access to port :18100. Data downloads are also now HTTPS-only.

• Fixed a rare issue where custom rules could be accidentally deleted.
• Significant performance improvements in the Search API.
• Improved crawling performance and site coverage in the Global Index.
• Improved ability to identify, analyze and return background images in all extraction APIs.

• Fixed an issue in the Video API where the url value would retain HTML escaping if present within the original page source.
• Fixed a rare crawling issue that occasionally resulted in "Bad IP" status messages for individual pages.
• Fixed an issue where empty <video> elements could be returned in the Article API.

Fixed an issue in the Global Index in which complicated Boolean (OR) queries would return no results.

• Improved date normalization to include Hijri and Jalali dates
• Fixed support for unicode characters in API Toolkit rules

• Many improvements to brand detection in the Product API.
• Resolved an issue where humanLanguage could be mis-identified on some Spanish-language pages.

• Crawlbot: resolved an issue where IP-address-only webhooks would not receive notifications.
• Crawlbot: improved link spidering/harvesting resilience to markup errors and other invalid HTML source.
• Fixed an issue where custom APIs would not display in Crawlbot and Bulk Processing dashboard.

• Improved link-detection when returning page links via our &fields=links argument.
• Improved support for and handling of the srcset (and sizes) image attributes in all APIs.
• Added detection of Afrikaans (af) in the humanLanguage field.
• Improved duplicate detection in the Diffbot Global Index.