by Kris Negulescu

We've added type:Research to the graph. Each entity is a journal article or research publication from a validated source. Data will continue to flow for the next month or so as we integrate all of the available metadata from OpenAlex.org. Future phases will combine OpenAlex metadata with the full text of the publication extracted from HTML or PDF (when it is publicly available to access) and will include data provenance and fair use details. Try a search for journal articles that include AI in the title: type:Research title:"AI" sortBy:date

Convert JSON to CSV

by Kris Negulescu

We built a fast JSON to CSV converter that supports automatic list detection, a column selection UI, and offline mode. Try it out here.

Diffbot ChatGPT Plug-in

by Kris Negulescu

Diffbot's ChatGPT plugin is available to everyone free of charge. The only requirement is a subscription to ChatGPT Plus for access to plugins. Get the Diffbot plugin by searching for "Diffbot" in the ChatGPT plugin store under the GPT-4 tab. Click here to find Diffbot on ChatGPT.

NL API Summarization

by Kris Negulescu

The NL API now has the ability to summarize text. Summarization in the NL API uses the Diffbot LLM for fast inference. There is no truncation. Long documents are broken into chunks and summarized individually. A final summary is generated from these chunk summaries.

See the NL API summarization demo here.

Enhance will now generate Coverage Reports in the background rather than during the execution of the bulkjob to speed up completion of bulkjobs. Previously, users could download the report immediately following completion of the bulkjob. Users should now poll the bulkjob status to ensure that the coverage report is generated. Status is available under content.reports[].status and should have the value of COMPLETE to indicate that the report is generated.

The changes are described here: https://docs.diffbot.com/reference/bulkjobstatus
*Please note that this change DOES NOT affect the behavior of bulkjob results - only the coverage report.

We have trained a new LLM model for the generation of Organization.summary. We can generate about ~5 million summaries per month using this new approach. We have prioritized private corporation entities to update first. These new summaries began appearing in the KG on July 7th. Please share your feedback and coverage requests with [email protected].

We've updated Diffbot's Privacy Policy.
Effective Date: April 10, 2023

We care deeply about your privacy. Recently, we discontinued all advertising, cookie, and web beacon-based tracking on www.diffbot.com. Instead, we use Plausible Analytics for Visitor analytics and website reporting. Please note: Trial Users & Subscribers who create an account with Diffbot are still required to accept cookies to use the Diffbot Dashboard or Leadgraph web applications.

While we've discontinued advertising, we do plan to continue to send the occasional marketing newsletter to update you on recent product launches and programs. Want to change how you receive these emails? You can update your preferences or unsubscribe from the list by contacting us at [email protected] or by clicking the 'unsubscribe' link in the footer of the newsletter.

Major additions to the Diffbot Privacy Policy include:

  • a supplemental Privacy Policy for CA Residents that can be found here.
  • a supplemental Privacy Policy for EEU Residents that can be found here. Please Note: a section of this policy is dedicated to individuals residing in the European Economic Area (EEA), the UK, and Switzerland.

These additions expand the protections and rights of Users under the California Privacy Rights Act, Cal. Civ. Code §§ 1798.100 et seq. (“CPRA”), EU Data Protection Laws, other laws of the European Union or any Member State thereof, the UK GDPR, and the laws of any other country or state to which you may be subject.

Major edits made to and removals from the policy and additional terms include:

  • an updated list of subprocessors [most notably we added Plausible Analytics and removed all third parties supporting advertising services],
  • an updated Cookie Policy,
  • an updated DPA [contact [email protected] to execute the April 2023 DPA or to amend a DPA we already have on file with your organization], and
  • clarification of data collected from Visitors vs. Trial Users vs. Subscribers.