• Added column to the Crawlbot and Bulk API URL Report indicating if a proxy IP was used.
• Added the argument useProxies to Crawlbot, which allows for proxy IPs to be used for specific crawls

Added proxy usage tracking to the Account API.

• Added available colors (if found on the page) to the normalizedSpecs object in the Product API. Updated format of normalizedSpecs to return multiple values, if available, for a single key.
• Fixed an issue where image URLs with spaces in the filename would be incorrectly returned.
• Improved proxy support in the extraction APIs to help diversify origin IPs. Read more.

• Released the tagConfidence argument in the Article API, allowing for the return of tags with lower relevance scores if desired.
• Improved Crawlbot handling of DNS and other connection issues; increased range of TLDs supported by Crawlbot.
• Fixed an issue where duplicate tags were being returned when sentiment analysis was being performed.

• Updated Crawlbot seeds behavior, so that if a non-www subdomain is specified as the only seed URL, crawling will restrict itself to that subdomain.
• Significant updates to the beta normalizedSpecs field in the Product API. See more details.
• Added the field parentUrlDocId to Crawlbot and Bulk Processing JSON objects. This field can be used to match objects to URLs in the Crawlbot or Bulk Processing URL Report.

• Added the originalType field to extracted objects when utilizing the Analyze API's' fallback argument.
• Fixed an issue with our Semantria integration that could lead to errant timeout responses.

• Fixed an issue in the Article API to prevent in-line Javascript and CSS from being returned in the html field from unsupported video players.
• Discussion API: Improved extraction from single-post (no reply) conversations.
• Improvements to video extraction within the Video API.

• Added beta fields quantityPrices, priceRange and multiplePrices to the Product API.
• Improved availability detection and extraction in the Product API.
• Improved offerPrice detection in the Product API to reduce the chance of returning an incorrect value from unavailable products or items without a visible price.

Significant speed improvements to the Global Index.

• Released an official endpoint for Custom API management. Please see the documentation for information on programmatic management of custom rules and APIs.
• Improved video extraction in the Article API to include new providers and HTML5 <video> elements.
• max:date queries in the Search and Global Index APIs are now inclusive of the date specified.