Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

OpenScholar: The open-source A.I. that’s outperforming GPT-4o in scientific research

Nov 21, 2024 - news.bensbites.com
The Allen Institute for AI (Ai2) and the University of Washington have developed an artificial intelligence system, OpenScholar, that can access, evaluate, and synthesize scientific literature. The system uses a retrieval-augmented language model to tap into a datastore of over 45 million open-access academic papers, retrieve relevant papers, synthesize their findings, and generate an answer grounded in those sources. In tests, OpenScholar demonstrated superior performance on factuality and citation accuracy, outperforming larger proprietary models like GPT-4o.

OpenScholar is fully open-source and its team has released the code for the language model, the entire retrieval pipeline, a specialized 8-billion-parameter model fine-tuned for scientific tasks, and a datastore of scientific papers. Despite its limitations, such as its reliance on open-access papers, OpenScholar represents a significant development in scientific computing, demonstrating the capacity to process, understand, and synthesize scientific literature with near-human accuracy. The system could become an essential tool for accelerating scientific discovery by helping researchers synthesize knowledge faster and with greater confidence.

Key takeaways:

  • A new artificial intelligence system, OpenScholar, developed by the Allen Institute for AI and the University of Washington, can access, evaluate, and synthesize scientific literature from over 45 million open-access academic papers.
  • OpenScholar outperformed larger proprietary models like GPT-4o in tests, particularly in citation accuracy and factuality, and did not generate fabricated citations.
  • Unlike other AI systems, OpenScholar is fully open-source, with the team releasing the code for the language model, the entire retrieval pipeline, a specialized 8-billion-parameter model, and a datastore of scientific papers.
  • Despite its advantages, OpenScholar has limitations, including its reliance on open-access papers, which excludes paywalled research that dominates some fields. The researchers hope future iterations can incorporate closed-access content.
View Full Article

Comments (0)

Be the first to comment!