Back to All

2016-03-25

March 25th, 2016 by Jerome Choo
  • Updated Crawlbot seeds behavior, so that if a non-www subdomain is specified as the only seed URL, crawling will restrict itself to that subdomain.
  • Significant updates to the beta normalizedSpecs field in the Product API. See more details.
  • Added the field parentUrlDocId to Crawlbot and Bulk Processing JSON objects. This field can be used to match objects to URLs in the Crawlbot or Bulk Processing URL Report.