Job API docs:
https://docs.diffbot.com/reference/job

We've updated Diffbot's Privacy Policy.
Effective Date: April 10, 2023

We care deeply about your privacy. Recently, we discontinued all advertising, cookie, and web beacon-based tracking on www.diffbot.com. Instead, we use Plausible Analytics for Visitor analytics and website reporting. Please note: Trial Users & Subscribers who create an account with Diffbot are still required to accept cookies to use the Diffbot Dashboard or Leadgraph web applications.

While we've discontinued advertising, we do plan to continue to send the occasional marketing newsletter to update you on recent product launches and programs. Want to change how you receive these emails? You can update your preferences or unsubscribe from the list by contacting us at [email protected] or by clicking the 'unsubscribe' link in the footer of the newsletter.

Major additions to the Diffbot Privacy Policy include:

• a supplemental Privacy Policy for CA Residents that can be found here.
• a supplemental Privacy Policy for EEU Residents that can be found here. Please Note: a section of this policy is dedicated to individuals residing in the European Economic Area (EEA), the UK, and Switzerland.

These additions expand the protections and rights of Users under the California Privacy Rights Act, Cal. Civ. Code §§ 1798.100 et seq. (“CPRA”), EU Data Protection Laws, other laws of the European Union or any Member State thereof, the UK GDPR, and the laws of any other country or state to which you may be subject.

Major edits made to and removals from the policy and additional terms include:

• an updated list of subprocessors [most notably we added Plausible Analytics and removed all third parties supporting advertising services],
• an updated Cookie Policy,
• an updated DPA [contact [email protected] to execute the April 2023 DPA or to amend a DPA we already have on file with your organization], and
• clarification of data collected from Visitors vs. Trial Users vs. Subscribers.

We pushed several breaking changes to Article data, Job Posts, Discussion Threads, and Product Offers in the KG.

FIRST:

The 'types' array was sorted with the most specific type first. We reversed the order to make the array consistent with 'types' in Organization, Person, and Place entities in the graph.

SECOND:
The 'types' array currently always contains GlobalIndexDiffbotEntity for Articles/Job Posts/Discussions/Product Offers. We have removed that unnecessary 'types' designation, i.e.

"types": [
"Article",
"GlobalIndexDiffbotEntity"
]

became

"types": [
"Article"
]

similar to

"types": [
"Organization",
"Corporation",
"Company"
]

FINALLY:
Some 'types' arrays previously contained GlobalIndexComplexTypeWrapper as well. We removed that unnecessary 'types' designation, i.e.

"types": [
"Discussion",
"GlobalIndexComplexTypeWrapper",
"GlobalIndexDiffbotEntity"
]

became

"types": [
"Discussion"
]

In the month of March, we rolled to production two key service layer optimizations to the Diffbot Knowledge Graph architecture. Both radically reduce response time to queries and enrichment requests. The first is called the KG Engine, a look-up service that enables us to improve the performance and scalability of both Enhance and DQL and to update the graph between builds for Organization and Person data. The second is a new search indexing layer that aggregates all Articles in the KG that were crawled &/or published in the last six months which reduces response times when querying recent news.

The Diffbot Knowledge Graph now supports NAICS 2022 Classifications (labels and codes) in addition to NAICS 2017 Classifications. See NAICS docs for more details.

The following is a list of arguments you can add to a Diffbot API call in order to reduce processing time when calling the Article or Analyze APIs:

• Turn off natural language processing to provide sentiment analysis (natural language processing adds the most time to an on-demand extraction call)

  &nl=false
  

• Turn off entity tagging and linking in text

  &notags
  

• Many publishers of articles provide text without having to render the page. If you need full HTML outputs for each page, you will not want to use this argument.

  &norender
  

We added support for the Stock Price News Category in the Natural Language API.

Example or Search

Added Organization.suppliers to the graph, i.e. type:Organization suppliers.name:"Diffbot"

Added support for non-software technologies such as:

• type:Organization technographics.technology.name:"3D food printing" and
• type:Technology technologyCategories:"Manufacturing"

Added new organization industries to the graph including:

• Real Estate > Real Estate Investment Trusts (naics: 525930)
• Financial Services > Banks > Central Banks (naics: 521110)
• Financial Services > Credit Unions (naics: 522130)
• Financial Services > Money Exchange Providers (to include Foreign exchange companies, and Online remittance providers)
• Services > Laundry Companies (naics: 812320)
• Food > Dairy Companies (naics: 112120)
• Food > Cocoa Companies (naics: 311351)
• Medical Organizations > Cannabis Companies
• Construction Companies > Landscaping Services (naics: 561730)
• Environmental Organizations > Recyclable Material Companies (naics: 423930) (we separated Waste Organizations And Recycling Facilities into "Waste Organizations" and "Recyclable Material Companies")
• Consumer Service Companies > Parking Companies (naics: 812930)
• Hospitality Companies > Adult Entertainment Clubs
• Retailers > Vending machine operators (naics: 454210)
• Retailers > Used Merchandise Retailers (naics: 459510)
• Educational Organizations > | Educational Institutions > K12 Schools (to check the differences with Schools and clean in case)

Added Place.headOfPlace and corresponding employment
Heads of state and heads of government

Added Organization.employeeCategories
Organizations with a particular number of people in a department (e.g., sales)

Coverage Reports for Bulk Enhance Jobs (CSV)
The Coverage Report is a detailed summary of attribute coverage, per entity, and includes the % coverage per field in the dataset overall. The report is downloadable as a CSV from the Report API: https://kg.diffbot.com/kg/v3/enhance/bulk//. The report information is also included in the Enhance Bulk job Status API response: https://kg.diffbot.com/kg/v3/enhance/bulk//status, and can be specified for inclusion with the parameters filter or exportspec