AI Agents for science
Outsourcing knowledge of base reality to bots
2023-01-22 — 2026-07-01
Wherein the Scientific Literature Is Navigated by Autonomous Agents, With Particular Attention to Systems That Read Thousands of Papers and Synthesise Citations Without Human Intervention.
A list of attempts and approaches to make scientific knowledge management and discovery — for science in particular — work with generative AI agents. This seems to be heavy in AI search for scientific knowledge discovery (“Deep research”), but of course there are many other steps in the scientific process.
1 FutureHouse / Edison
Fresh off the rack — it looks interesting. It synthesizes existing literature and identifies research gaps and areas of comparative advantage.
UPDATE: The FutureHouse platform was spun off into Edison Scientific. Their new model, Kosmos, sounds interesting: Kosmos: An AI Scientist for Autonomous Discovery:
Previous generations of AI Scientists, like FutureHouse’s Robin, have been limited primarily in their ability to synthesize large amounts of information. The finite context length of language models has meant that an AI Scientist can only take so many steps or make so many logical leaps before it runs out of road, limiting the complexity of the discoveries it can make. The core innovation in Kosmos is our use of structured world models, which allow us to efficiently incorporate information extracted over hundreds of agent trajectories and maintain coherence towards a specific research objective over tens of millions of tokens. An individual Kosmos run involves reading 1500 papers and running 42,000 lines of analysis code, far more than any other agent we are aware of.
2 AI2
Ai2 OpenScholar: Scientific literature synthesis with retrieval-augmented language models | Ai2/ Source provides infrastructure for search via vector embeddings specialized for science papers.
Dissatisfied with the crappy search for ICLR, I built a quick semantic search using Ai2’s system. It was easy and worked really well! I put it here: danmackinlay/openreview_finder. It takes about 10 minutes to download and index the ICLR 2025 papers.
Ai2’s current stack for scientific workflows seems to centre on Asta and OpenScholar, two complementary (?) efforts that rely on large scholarly corpora to keep answers grounded and citable. Asta acts as a broader platform (agents, benchmarks, developer resources), while OpenScholar focuses on retrieval-augmented, citation-backed literature synthesis and has strong evaluation results.
AFAICT, Asta provides the broader scaffolding (agents, benchmarks, standards) for trustworthy scientific AI, while OpenScholar is a specialized literature-synthesis system that plugs into that ecosystem and supports evidence-grounded workflows. Both emphasize citing sources, enable reproducible, inspectable reasoning steps, and provide useful open tech-stack tools for researchers and developers.
- Scholar QA → Asta — migration note: asta.allen.ai/synthesize
2.1 Asta
- Agentic research ecosystem: an AI research assistant, the AstaBench suite, and developer resources designed for transparency, reproducibility, and open development (blog post).
- Trust-first framing: launched as a “standard for trustworthy AI agents in science,” emphasizing verifiable, source-traceable outputs and an open framework.
- Practical capabilities: the assistant offers LLM-powered paper discovery, literature synthesis with clickable citations, and early-stage data analysis (in beta for partners).
- Benchmarks with receipts: AstaBench provides rigorous, holistic evaluation of scientific agents, aiming to clarify performance beyond anecdotes.
- Scholar QA has been folded into Asta (now “Summarize literature”), signalling a single, unified assistant surface.
3 Feyman
ships as either a full agentic loop or as a bundle of skills
Example queries:
feynman "what do we know about scaling laws"
#Cited research brief from papers and web
feynman rank "sparse autoencoders"
#PaperRank table with citation, graph, methodology, and reproducibility scores
feynman deepresearch "mechanistic interpretability"
#Multi-agent deep dive with synthesis and verification
feynman lit "RLHF alternatives"
#Literature review with consensus and open questions
feynman audit 2401.12345
#Paper claims vs. what the code actually does
feynman replicate "chain-of-thought improves math"
#Replication plan, compute target, gated experiment steps
feynman recipe "fine-tune a small model for math reasoning"
#Ranked, implementable ML training recipes4 Denario
Meet Denario — an AI assistant for every step of the scientific process
The new tool, developed by scientists at the Flatiron Institute, Cambridge University, the Autonomous University of Barcelona and others, leverages large language models to help scientists with tasks from developing new hypotheses to summarizing results. The team hopes Denario will make the research process faster, more dynamic and more interdisciplinary.
AstroPilot-AI/Denario (Villaescusa-Navarro et al. 2025):
Denario is a multiagent system designed to be a scientific research assistant. Denario implements AI agents with AG2 and LangGraph, using cmbagent as the research analysis backend.
- 🌐 Project page
- 📖 Documentation
- 🖥️ Denario GUI repository
- 🤗 Demo web app for Denario GUI
- 📝 End-to-end research papers generated with Denario
- 🎥 YouTube channel
Cute update:
October 9, 2025 - A paper fully generated with Denario has been accepted for publication in the Open Conference of AI Agents for Science 2025, the 1st open conference with AI as primary authors.
4.1 OpenScholar
- Purpose-built RAG for science: OpenScholar answers research questions by retrieving passages from a very large scientific datastore and synthesizing citation-backed responses, with an iterative self-feedback loop to improve quality.
- Scale of sources: The OpenScholar DataStore (OSDS) spans tens of millions of open-access papers and hundreds of millions of passage embeddings, enabling broad coverage across domains.
- Evaluation signal: OpenScholar reports higher correctness than larger closed-source models on ScholarQABench while keeping citation accuracy at expert-like levels and reducing fabricated references.
- Open ecosystem: The code, models, datastore, and a public demo are open source, which makes it straightforward to inspect and extend the full pipeline.
5 Elicit
Elicit: The AI Research Assistant:
Elicit uses language models to help you automate research workflows, like parts of literature review.
Elicit can find relevant papers without perfect keyword match, summarise takeaways from the paper specific to your question, and extract key information from the papers.
While answering questions with research is the main focus of Elicit, there are also other research tasks that help with brainstorming, summarisation, and text classification.
Recently they have started one-click meta-analyses, which is huge.
6 Consensus
Search - Consensus: AI Search Engine for Research
Consensus is the AI-powered academic search engine
Search & analyse 200M+ peer-reviewed research papers
7 Tool Universe
…the AI scientist operates as follows: given a user instruction or task, it formulates a plan or hypothesis, employs the tool finder in ToolUniverse to identify relevant tools, and iteratively applies these tools to gather information, conduct experiments, verify hypotheses, and request human feedback when necessary. For each required tool call, the AI scientist generates arguments that conform to the ToolUniverse protocol, after which ToolUniverse executes the tool and returns the results for further reasoning.
S. Gao et al. (2025): >TOOLUNIVERSE standardizes how AI scientists identify and call tools by providing more than 600 machine learning models, datasets, APIs, and scientific packages for data analysis, knowledge retrieval, and experimental design. It automatically refines tool interfaces for correct use by AI scientists, generates new tools from natural language descriptions, iteratively optimizes tool specifications, and composes tools into agentic workflows.
8 SciLire
SciLire: Science Literature Review AI Tool from CSIRO.
I just saw a tech demo of SciLire from my colleagues. It looks promising for high-speed, AI-augmented literature reviews. On the other hand, CSIRO — like most Australian tech projects — isn’t well resourced, so I’m less than optimistic.
8.1 ResearchRabbit
UPDATE: Litmaps acquired ResearchRabbit in 2025 and relaunched it under a freemium subscription model — no longer an independent product.
- Spotify for Papers: Just like in Spotify, you can add papers to collections. ResearchRabbit learns what you love and improves its recommendations!
- Personalised Digests: Keep up with the latest papers related to your collections! If we’re not confident something’s relevant, we don’t email you—no spam!
- Interactive Visualisations: Visualise networks of papers and co-authorships. Use graphs as new “jumping off points” to dive even deeper!
- Explore Together: Collaborate on collections, or help kickstart someone’s search process! And leave comments as well!
8.2 scite
scite: See how research has been cited
Citations are classified by a deep learning model that is trained to identify three categories of citation statements: those that provide contrasting or supporting evidence for the cited work, and others, which mention the cited study without providing evidence for its validity. Citations are classified by rhetorical function, not positive or negative sentiment.
- Citations are not classified as supporting or contrasting by positive or negative keywords.
- A Supporting citation can have a negative sentiment and a Contrasting citation can have a positive sentiment. Sentiment and rhetorical function are not correlated.
- Supporting and Contrasting citations do not necessarily indicate that the exact set of experiments was performed. For example, if a paper finds that drug X causes phenomenon Y in mice and a subsequent paper finds that drug X causes phenomenon Y in yeast but both come to this conclusion with different experiments—this would be classified as a supporting citation, even though identical experiments were not performed.
- Citations that simply use the same method, reagent, or software are not classified as supporting. To identify methods citations, you can filter by the section.
For full technical details including exactly how we do classification, what classifications and classification confidence mean, please read our recent publication describing how scite was built: (Nicholson et al. 2021)/
9 Incoming
Agent Laboratory: Using LLM Agents as Research Assistants
Agent Laboratory takes input from a human-produced research idea and outputs a research report and code repository. Agent Laboratory is meant to assist you as the human researcher in implementing your research ideas. You are the pilot. Agent Laboratory provides a structured framework that adapts to your computational resources, whether you’re running it on a MacBook or on a GPU cluster. Agent Laboratory consists of specialised agents driven by large language models to support you through the entire research workflow—from conducting literature reviews and formulating plans to executing experiments and writing comprehensive reports. This system is not designed to replace your creativity but to complement it, enabling you to focus on ideation and critical thinking while automating repetitive and time-intensive tasks like coding and documentation. By accommodating various levels of computational resources and human involvement, Agent Laboratory aims to accelerate scientific discovery and optimise your research productivity.