TL;DR: Today weβre releasing a new episode of our podcast AI & I. I go in depth with Dr. Bradley Love, a professor of cognitive and decision sciences in experimental psychology at University College London and one of the builders of BrainGPT, an LLM focused on assisting neuroscientific research. We dive into how AI is changing the way we do science by making predictions about the future. Watch on X or YouTube, or listen on Spotify or Apple Podcasts.
Science is brokenβand Dr. Bradley Love thinks AI might just fix it.
The problem with science is that itβs always been conducted in siloes. Letβs break this down with an example from the science closest to us, the science of our bodies.
Imagine youβre suffering from an unnatural hankering for high-calorie, sugary, greasy food. Your endocrinologist would peg it to chronically high cortisol levels. Your gastroenterologist would blame your gut microbiome. A neuroscientist might study your hypothalamus, and your therapist might link it to seasonal depression.
Of course, we all know that reality is much more complicated than any one of these singular explanations. But experts are unable to see the forest for the trees. Understandably so. The human brain is unable to fathomβlet alone processβthe complex nature of reality.
AI doesnβt have these limitations. It can process large amounts of data across different domains, find patterns in itβand predict what will come next.
Dr. Love is putting this idea into practice as one of the creators of BrainGPT, an LLM that helps people conduct neuroscientific research. While most LLMs are good at looking back on information we already have, excelling at tasks like summarizing, BrainGPT is laser-focused on the future. The LLM capitalizes on AIβs ability to process large chunks of information to find patterns and make predictions about new situations.
This shift toward predictions could fundamentally change the way research is done, and I sat down with Dr. Love to talk about what this means for the next generation of scientists. It was a fascinating conversation about the interplay between philosophy, science, and AI.
Apart from building BrainGPT, Dr. Love is also a professor of cognitive and decision sciences in experimental psychology at University College London, and a fellow at The Alan Turing Institute for data science and AI, as well as the European Lab for Learning & Intelligent Systems. His lab focuses on understanding how people learn and make decisions, combining behavioral, computational, and neuroscience principles.
This is a must-watch for anyone interested in the future of science, AI, and how we understand the human mind. Hereβs a taste:
- Creating a collective mind with AI. Dr. Love thinks of individual research papers as incomplete contributions to an expanding field of knowledge, and wants to use AI to engage with this collective mass of information. According to him, individual papers are βflawed, noisy, and incomplete,β and he hopes that LLMs, based on a βtapestry of thousands of papers,β can generate a βsignal in the correct direction.β
- Mimic the brain's computing efficiency. Dr. Love suggests looking to the human brain for a solution to the increasing energy demands of the AI revolution. βModern GPUs are amazingβ¦but these data centers are going up every day and itβs stressing the grid, there's carbon impactsβ¦whereas our brains are doing a lot of computation, but I guess you just have to eat a sandwich or something,β he says.
- Build synergy between humans and machines. While building BrainGPT, Dr. Love discovered the best way to get the LLM to accurately predict whether a research hypothesis was correct was to compute the βperplexityβ of the model, a metric that quantifies βhow surprising the text is to the model,β where a lower perplexity correlates with accuracy. He thinks this is significant for βhuman-machine teamingβ because βyou could get a better result than either one alone.β
How AI is reshaping scientific prediction and explanation
These are the ways in which Dr. Love believes the development of AI will challenge our conventional understanding of science:
- AI-guided experimentation. Dr. Love sees a future where we could use AI to answer complex questions like: βWhat experiment should I run next?β Taking it a step further, he thinks we could have models βgenerate different patterns of results,β and then compute the perplexity of each of these to surmise which is the most reasonable prediction.
- Embracing the power of predictions. According to Dr. Love, using LLMs to make predictions in biological science might lead to accurate predictions without full comprehension of the underlying mechanisms, given the field's complexity. βI could see a world in which explanation and prediction unfortunately divergeβ¦it's just because the world's really complex and our brains aren't built to make sense of this kind of stuff,β he adds.
- Shifting cognitive paradigms. Even though he likes having crisp explanations for the world around him, Dr. Love thinks that as technology and science develops, what humans accept as an explanation will also evolve. β[H]ow we understand the world must be so different now than 500 years agoβ¦so maybe it's just going to change again and weβre worrying about something that people in 100 years from now won't even think twice about,β he says.
What Dr. Love would do if he could rebuild the world of science
Dr. Love cautions that our quest for simple, intuitive explanations in science may be limiting our ability to truly understand complex phenomena. He says there are βso many variablesβ in biology that even though βyou could tell the clear, intuitive story,β it may not even be an βapproximation of the real thing, or itβll be so crude that itβll obscure deeper truths.β If he had a free hand at shaping the next era of science, hereβs what he would do:
- Future-proofing for scientists. Dr. Love thinks that the next generation of scientists should have strong computational skills and be proficient at thinking philosophically. βI would do a combination of training people to be a little more philosophical about things and maybe do some reading and thinking about what explanations are and the limits and the study of it, but also more emphasisβ¦on computational skills,β he says.
- Bridging experiments and reality. According to Dr. Love, scientists should integrate controlled experiments with data gathered from the real world to avoid the risk of creating isolated, potentially irrelevant subfields of study. βI think if you're going to run lab studies, there has to be an interplay with something more naturalistic [in the] real world [like with] big data,β he concludes.
You can check out the episode on X, Spotify, Apple Podcasts, or YouTube. Links and timestamps are below:
- Watch on X
- Watch on YouTube
- Listen on Spotify (make sure to follow to help us rank!)
- Listen on Apple Podcasts
Timestamps:
- Introduction: 00:01:00
- The motivations behind building a LLM that can predict the future: 00:01:58
- How studying the brain can solve the AI revolutionβs energy problem: 00:11:14
- Dr. Love and his team have developed a new way to prompt AI: 00:13:32
- Danβs take on how AI is changing science: 00:18:27
- Why clean scientific explanations are a thing of the past: 00:22:54
- How our understanding of explanations will evolve: 00:29:49
- Why Dr. Love thinks the way we do scientific research is flawed: 00:37:31
- Why humans are drawn to simple explanations: 00:40:42
- How Dr. Love would rebuild the field of science: 00:45:03
What do you use ChatGPT for? Have you found any interesting or surprising use cases? We want to hear from youβand we might even interview you. Reply here to talk to me!
Miss an episode? Catch up on my recent conversations with LinkedIn cofounder Reid Hoffman, a16z Podcast host Steph Smith, economist Tyler Cowen, writer and entrepreneur David Perell, founder and newsletter operator Ben Tossell, and others, and learn how they use AI to think, create, and relate.
If youβre enjoying my work, here are a few things I recommend:
- Subscribe to Every
- Follow me on X
- Subscribe to Everyβs YouTube channel
- Check out our new course, Maximize Your Mind With ChatGPT
The transcript of this episode is for paying subscribers.
Thanks to Rhea Purohit for editorial support.