<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en_US"><generator uri="https://jekyllrb.com/" version="4.4.1">Jekyll</generator><link href="https://arnavgupta.org/feed.xml" rel="self" type="application/atom+xml" /><link href="https://arnavgupta.org/" rel="alternate" type="text/html" hreflang="en_US" /><updated>2026-09-22T17:49:55-07:00</updated><id>https://arnavgupta.org/feed.xml</id><title type="html">Arnav Gupta</title><subtitle>Arnav Gupta — Data Scientist in Computational Biology at Gordian Biotechnology. ML &amp; AI systems for genomics, single-cell data, and drug-target discovery.</subtitle><author><name>Arnav Gupta</name></author><entry><title type="html">When Every Lab Asks the Same AI</title><link href="https://arnavgupta.org/blog/everyones-agent-read-the-same-papers/" rel="alternate" type="text/html" title="When Every Lab Asks the Same AI" /><published>2026-07-30T00:00:00-07:00</published><updated>2026-07-30T00:00:00-07:00</updated><id>https://arnavgupta.org/blog/everyones-agent-read-the-same-papers</id><content type="html" xml:base="https://arnavgupta.org/blog/everyones-agent-read-the-same-papers/"><![CDATA[<p><em>More hypotheses do not automatically mean more biology explored.</em></p>

<p>Imagine your agent returns ten promising targets for fibrosis. Each comes with a mechanism, supporting papers, and an experiment to run next. It looks like a useful afternoon’s work.</p>

<p>Now imagine another biotech asking the same model a similar question, with access to the same public databases. How much of its shortlist would overlap with yours?</p>

<p>That is the question I think deserves more attention as research agents enter biology. Ideas are getting cheaper. Experiments remain expensive. If we spend that experimental budget testing variations of the same familiar hypotheses, faster idea generation only gets us so far.</p>

<h2 id="a-good-answer-can-come-from-a-narrow-pool">A good answer can come from a narrow pool</h2>

<p>A Stanford study generated 4,000 research ideas per topic in natural language processing. After deduplication using the authors’ similarity measure, about 200 distinct ideas remained per topic, on average. Further generation increasingly revisited ideas already proposed.<sup id="fnref:1"><a href="#fn:1" class="footnote" rel="footnote" role="doc-noteref">1</a></sup></p>

<p>Yet the same study found that selected AI ideas were rated more novel than ideas from human researchers. An agent can offer a compelling suggestion while producing a surprisingly repetitive collection of suggestions.</p>

<p>For a research team, both levels matter. You want each hypothesis to be credible. You also want the set to cover meaningfully different possibilities. Ten plausible targets are less informative if all ten depend on the same untested assumption.</p>

<h2 id="biologys-literature-is-an-uneven-map">Biology’s literature is an uneven map</h2>

<p>In 2018, researchers studying scientific attention noted that most human gene research concentrated on roughly 2,000 of about 19,000 genes. Gene properties and knowledge of homologs in model organisms explained much of that attention. What gets studied reflects a history of experimental accessibility and accumulated knowledge, alongside disease relevance.<sup id="fnref:2"><a href="#fn:2" class="footnote" rel="footnote" role="doc-noteref">2</a></sup></p>

<p>That creates a problem worth watching as agents help nominate targets. A familiar gene comes with an abundance of mechanisms, assays, and citations. An understudied gene may be harder to build a convincing explanation around, even when an experiment gives you a reason to investigate it.</p>

<p>My concern is that we could mistake the ease of explaining a target for the strength of the case for pursuing it.</p>

<p>Scientists already have this tendency. Historical work on biomedical chemistry found a strong preference for revisiting established chemical relationships.<sup id="fnref:3"><a href="#fn:3" class="footnote" rel="footnote" role="doc-noteref">3</a></sup> AI gives us a way to reproduce familiar starting points much faster.</p>

<p>A 2026 <em>Nature</em> analysis of 41.3 million papers found a related tension: researchers using AI had higher publication and citation counts, while AI-associated work covered a narrower topical space. This was an observational study spanning multiple eras of AI, including traditional machine learning. It does not establish that current LLM agents cause labs to converge, but it gives us reason to question whether greater output necessarily means broader exploration.<sup id="fnref:4"><a href="#fn:4" class="footnote" rel="footnote" role="doc-noteref">4</a></sup></p>

<h2 id="give-your-agent-a-reason-to-reach-a-different-conclusion">Give your agent a reason to reach a different conclusion</h2>

<p>I would start with three changes to how a biotech team uses research agents.</p>

<p><strong>1. Let different evidence shape the initial hypotheses.</strong></p>

<p>Start one search from human genetics, another from perturbation results, and another from clinical observations. Let each develop its case independently before comparing the conclusions. Where they disagree, ask which assumptions or pieces of evidence account for the difference.</p>

<p>There is some support for deliberately varying starting perspectives. A Columbia Business School preprint found that diverse personas improved idea diversity, and combining them with structured reasoning prompts surpassed the human comparison on key diversity measures. Those experiments involved fitness-product ideas, so their application to biology still needs testing. But they show that prompting can widen a model’s search.<sup id="fnref:5"><a href="#fn:5" class="footnote" rel="footnote" role="doc-noteref">5</a></sup></p>

<p>For a scientific workflow, I would go further and vary the evidence itself. Giving three agents different job titles is a useful experiment; giving them different observations is a more direct test of whether those observations change the answer.</p>

<p><strong>2. Make your own experimental history usable.</strong></p>

<p>The evidence that changes a shortlist might already exist inside your team.</p>

<p>Suppose a target has strong literature support, but your own experiment showed no effect in the relevant cell type. That result needs context: was the perturbation effective? Was the assay sensitive enough? Did the effect disappear only under a particular condition?</p>

<p>Depending on those answers, the next step could be to abandon the hypothesis, repeat the measurement, or investigate why the context matters. A record that says only “no effect” cannot support that decision.</p>

<p>This is why I think experimental history belongs inside the hypothesis-generation workflow. Preserve the conditions, controls, unsuccessful attempts, and reasoning behind changes in direction. Connect them to the question the agent is being asked now.</p>

<p>Where the evidence is missing, design experiments to fill that gap. A new cohort, time point, or biological model is valuable when it resolves a specific uncertainty. Owning more data does not, by itself, make your conclusions better.</p>

<p><strong>3. Evaluate the alternatives your shortlist preserves.</strong></p>

<p>Compare your recommendations with a baseline built from public evidence alone. Then look beyond whether the gene names differ.</p>

<p>Do the hypotheses involve different mechanisms? Do they make different predictions? Would the proposed experiments distinguish between competing explanations? Which recommendations changed because of something your team learned?</p>

<p>Some agreement is exactly what you want: strong evidence should lead people toward similar conclusions. The useful test is whether your system can recognize a credible reason to reconsider them.</p>

<p>When your own data changes an agent’s answer, you should be able to see which evidence made the difference.</p>

<p>Everyone can read the same papers. What your team can add is the knowledge it earns by doing the work: the result that failed to replicate, the condition that changed an effect, the observation that made you reconsider a mechanism.</p>

<p>The advantage I would build toward is an agent that carries those lessons into the next experiment. When experiments are expensive, remembering what should change your mind matters as much as generating something new to try.</p>

<h2 id="references">References</h2>

<div class="footnotes" role="doc-endnotes">
  <ol>
    <li id="fn:1">
      <p>Si C, Yang D, Hashimoto T. <a href="https://arxiv.org/abs/2409.04109">Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers</a>. <em>ICLR</em> (2025); preprint first posted in 2024. <a href="#fnref:1" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:2">
      <p>Stoeger T, Gerlach M, Morimoto RI, Nunes Amaral LA. <a href="https://doi.org/10.1371/journal.pbio.2006643">Large-scale investigation of the reasons why potentially important genes are ignored</a>. <em>PLOS Biology</em> 16(9):e2006643 (2018). <a href="#fnref:2" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:3">
      <p>Foster JG, Rzhetsky A, Evans JA. <a href="https://doi.org/10.1177/0003122415601618">Tradition and Innovation in Scientists’ Research Strategies</a>. <em>American Sociological Review</em> 80(5):875–908 (2015). <a href="https://arxiv.org/abs/1302.6906">Open preprint</a>. <a href="#fnref:3" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:4">
      <p>Hao Q, Xu F, Li Y, Evans J. <a href="https://doi.org/10.1038/s41586-025-09922-y">Artificial intelligence tools expand scientists’ impact but contract science’s focus</a>. <em>Nature</em> 649:1237–1243 (2026). <a href="https://arxiv.org/abs/2412.07727">Open author manuscript</a>. <a href="#fnref:4" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:5">
      <p>Deng Y, Brucks M, Toubia O. <a href="https://arxiv.org/abs/2602.20408">Examining and Addressing Barriers to Diversity in LLM-Generated Ideas</a>. arXiv:2602.20408 (2026). Preprint. <a href="#fnref:5" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
  </ol>
</div>]]></content><author><name>Arnav Gupta</name></author><category term="AIxBio" /><category term="agentic AI" /><category term="drug discovery" /><category term="AI best practices" /><summary type="html"><![CDATA[AI makes hypotheses cheap. For biotech teams, the harder question is whether those hypotheses lead somewhere different - and what evidence would change the answer.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://arnavgupta.org/assets/images/blog/everyones-agent-read-the-same-papers.jpg" /><media:content medium="image" url="https://arnavgupta.org/assets/images/blog/everyones-agent-read-the-same-papers.jpg" xmlns:media="http://search.yahoo.com/mrss/" /></entry><entry><title type="html">Ideas Are Cheap Now. Experiments Are Not.</title><link href="https://arnavgupta.org/blog/ideas-are-cheap-experiments-are-not/" rel="alternate" type="text/html" title="Ideas Are Cheap Now. Experiments Are Not." /><published>2026-06-17T00:00:00-07:00</published><updated>2026-06-17T00:00:00-07:00</updated><id>https://arnavgupta.org/blog/ideas-are-cheap-experiments-are-not</id><content type="html" xml:base="https://arnavgupta.org/blog/ideas-are-cheap-experiments-are-not/"><![CDATA[<p>Agentic AI is changing how biotech organizations reason about their data. Over the past year, one consequence has become difficult to ignore. Generating a credible hypothesis is no longer the rate-limiting step in discovery.</p>

<h2 id="the-cost-of-a-hypothesis-has-collapsed">The cost of a hypothesis has collapsed</h2>

<p>Until recently, a cross-dataset question inside a biotech company required a queue. A computational scientist had to locate the data, clean it, integrate it with other sources, and write the analysis. That process took days and often weeks.</p>

<p>An agentic system can now produce a reasonable first pass in an afternoon. It can draw on internal omics data, public genetics, and the literature. It then returns ranked hypotheses with the reasoning attached.</p>

<p>Two published studies show what this looks like in practice. Both used Google’s AI co-scientist, a multi-agent system built on Gemini 2.0<sup id="fnref:1"><a href="#fn:1" class="footnote" rel="footnote" role="doc-noteref">1</a></sup>. Researchers at Imperial College London asked it how a class of mobile genetic elements spreads across bacterial species. Within two days, its leading hypothesis matched a mechanism the team had established through years of unpublished experimental work<sup id="fnref:2"><a href="#fn:2" class="footnote" rel="footnote" role="doc-noteref">2</a></sup><sup id="fnref:3"><a href="#fn:3" class="footnote" rel="footnote" role="doc-noteref">3</a></sup>. At Stanford, Gary Peltz’s group used the same system to nominate drugs for repurposing in liver fibrosis. The system proposed three candidates, and Peltz selected two of his own. Two of the AI-nominated drugs reduced fibrosis in human liver organoids. Neither of his selections did<sup id="fnref:3:1"><a href="#fn:3" class="footnote" rel="footnote" role="doc-noteref">3</a></sup><sup id="fnref:4"><a href="#fn:4" class="footnote" rel="footnote" role="doc-noteref">4</a></sup><sup id="fnref:5"><a href="#fn:5" class="footnote" rel="footnote" role="doc-noteref">5</a></sup>.</p>

<h2 id="analysis-is-no-longer-a-specialist-privilege">Analysis is no longer a specialist privilege</h2>

<p>The more important change is who gets to ask the question. Bench scientists, program leads, and new hires can now interrogate data directly. The people who best understand an assay’s limitations can test their own intuitions without waiting for analyst time.</p>

<p>I believe this raises the collective intelligence of an organization. More people with real context are forming views grounded in evidence. The pool of hypotheses becomes both larger and stronger.</p>

<p>This shift carries a risk. Inexpensive ideas also produce a great deal of confident, plausible noise. System design matters. In the Imperial study, several general-purpose language models received the same question. None produced the hypotheses that proved experimentally correct<sup id="fnref:3:2"><a href="#fn:3" class="footnote" rel="footnote" role="doc-noteref">3</a></sup>. Grounding in real data, structured critique, and rigorous benchmarking separate genuine insight from fluent guessing.</p>

<h2 id="the-bottleneck-has-not-moved">The bottleneck has not moved</h2>

<p>Biology must still be tested in cells, in animals, and ultimately in patients. No model can shorten the time an animal study takes to run.</p>

<p>The Imperial researchers acknowledged this directly. They recognized that a novel AI-generated hypothesis could take years to validate. They therefore posed a question they had already answered in the laboratory<sup id="fnref:6"><a href="#fn:6" class="footnote" rel="footnote" role="doc-noteref">6</a></sup>.</p>

<p>Clinical development is even less forgiving. An industry analysis covering 2011 to 2020 placed the likelihood of approval from Phase I at 7.9%<sup id="fnref:7"><a href="#fn:7" class="footnote" rel="footnote" role="doc-noteref">7</a></sup>. A more recent Citeline estimate puts the figure at 6.7%<sup id="fnref:8"><a href="#fn:8" class="footnote" rel="footnote" role="doc-noteref">8</a></sup>. A larger supply of hypotheses will not change these numbers. Validated hypotheses will.</p>

<h2 id="what-separates-the-companies-that-succeed">What separates the companies that succeed</h2>

<p><strong>Safe adoption of AI.</strong> This requires clear data access policies, audit trails, formal evaluation of every agent workflow, and a named human accountable for each decision. Speed without trust only produces faster errors.</p>

<p><strong>A shorter path from hypothesis to test.</strong> The metric worth tracking is the number of days between an idea and its first experimental readout. Higher-throughput assays, laboratory automation, and tighter coordination between computational and experimental teams all reduce it. When ideas are nearly free, experimental throughput determines who leads.</p>

<p><strong>Proprietary data generation.</strong> Every organization’s agents can read the same publications and the same public atlases. Foundation models are becoming commodities as well. The durable advantage is data that no one else holds. Each experiment should sharpen the next round of hypotheses in a way competitors cannot replicate.</p>

<h2 id="conclusion">Conclusion</h2>

<p>AI has democratized the reasoning stage of discovery. It has not democratized the validation stage. The organizations that pull ahead will combine inexpensive hypotheses with fast, trusted experimentation. They will then return every result to a dataset that cannot be copied.</p>

<h2 id="references">References</h2>

<div class="footnotes" role="doc-endnotes">
  <ol>
    <li id="fn:1">
      <p>Gottweis J, Weng WH, Daryin A, Tu T, et al. Towards an AI co-scientist. arXiv:2502.18864 (2025). <a href="https://arxiv.org/abs/2502.18864">https://arxiv.org/abs/2502.18864</a> <a href="#fnref:1" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:2">
      <p>Penadés JR, Gottweis J, He L, Patkowski JB, et al. AI mirrors experimental science to uncover a mechanism of gene transfer crucial to bacterial evolution. <em>Cell</em> 188(23):6654-6665.e2 (2025). <a href="https://doi.org/10.1016/j.cell.2025.08.018">https://doi.org/10.1016/j.cell.2025.08.018</a> <a href="#fnref:2" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:3">
      <p>Dolgin E. Google’s AI Co-Scientist Scores Two Wins in Biology. <em>IEEE Spectrum</em>, 25 September 2025. <a href="https://spectrum.ieee.org/ai-co-scientist">https://spectrum.ieee.org/ai-co-scientist</a> <a href="#fnref:3" class="reversefootnote" role="doc-backlink">&#8617;</a> <a href="#fnref:3:1" class="reversefootnote" role="doc-backlink">&#8617;<sup>2</sup></a> <a href="#fnref:3:2" class="reversefootnote" role="doc-backlink">&#8617;<sup>3</sup></a></p>
    </li>
    <li id="fn:4">
      <p>Guan Y, Cui L, Inchai J, et al. AI-Assisted Drug Re-Purposing for Human Liver Fibrosis. <em>Advanced Science</em> 12(44):e08751 (2025). <a href="https://doi.org/10.1002/advs.202508751">https://doi.org/10.1002/advs.202508751</a> <a href="#fnref:4" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:5">
      <p>Google DeepMind. Co-Scientist: Finding new treatments for liver fibrosis. <a href="https://deepmind.google/blog/uncovering-repurposed-medicines-to-fight-liver-fibrosis/">https://deepmind.google/blog/uncovering-repurposed-medicines-to-fight-liver-fibrosis/</a> <a href="#fnref:5" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:6">
      <p>Imperial College London. Google’s AI co-scientist could enhance research, say Imperial researchers. 19 February 2025. <a href="https://www.imperial.ac.uk/news/261293/googles-ai-co-scientist-could-enhance-research/">https://www.imperial.ac.uk/news/261293/googles-ai-co-scientist-could-enhance-research/</a> <a href="#fnref:6" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:7">
      <p>BIO, Informa Pharma Intelligence, QLS Advisors. Clinical Development Success Rates and Contributing Factors 2011-2020. February 2021. <a href="https://www.bio.org/clinical-development-success-rates-and-contributing-factors-2011-2020">https://www.bio.org/clinical-development-success-rates-and-contributing-factors-2011-2020</a> <a href="#fnref:7" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
    <li id="fn:8">
      <p>pharmaphorum. Clinical development rates are falling, but it’s not all bad news. 18 July 2024. <a href="https://pharmaphorum.com/rd/clinical-development-rates-are-falling-its-not-all-bad-news">https://pharmaphorum.com/rd/clinical-development-rates-are-falling-its-not-all-bad-news</a> <a href="#fnref:8" class="reversefootnote" role="doc-backlink">&#8617;</a></p>
    </li>
  </ol>
</div>]]></content><author><name>Arnav Gupta</name></author><category term="AIxBio" /><category term="agentic AI" /><category term="drug discovery" /><category term="AI best practices" /><summary type="html"><![CDATA[Agentic AI has made hypothesis generation cheap and widely accessible. Experimental validation is still the bottleneck, and proprietary data is still the moat.]]></summary><media:thumbnail xmlns:media="http://search.yahoo.com/mrss/" url="https://arnavgupta.org/assets/images/blog/ideas-are-cheap-experiments-are-not.jpg" /><media:content medium="image" url="https://arnavgupta.org/assets/images/blog/ideas-are-cheap-experiments-are-not.jpg" xmlns:media="http://search.yahoo.com/mrss/" /></entry></feed>