SCS Katayanagi Distinguished Lecture - Noam Brown

— 6:00pm

Location:
In Person - Rashid Auditorium, Gates Hillman 4401

Speaker:
NOAM BROWN, Research Scientist, OpenAI
https://noambrown.github.io/

Learning to Reason with LLMs

Large language models (LLMs) have demonstrated remarkable capabilities in generating coherent text and completing various natural language tasks. Nevertheless, their ability to perform complex, general reasoning has remained limited. 

In this talk, I will describe OpenAI's new o1 model, an LLM trained via reinforcement learning to generate a hidden chain of thought before its response. We have found that the performance of o1 consistently improves with more reinforcement learning compute and with more inference compute. o1 surpasses previous state-of-the-art models in a variety of benchmarks that require reasoning, including mathematics competitions, programming contests, and advanced science question sets. I will discuss the implications of scaling this paradigm even further.

—

Noam Brown is a research scientist at OpenAI investigating reasoning and multi-agent AI. He co-created Libratus and Pluribus, the first AIs to defeat top humans in two-player no-limit poker and multiplayer no-limit poker, respectively, and Cicero, the first AI to achieve human-level performance in the natural language strategy game Diplomacy. He has received the Marvin Minsky Medal for Outstanding Achievements in AI, was named one of MIT Tech Review's 35 Innovators Under 35, and his work on Pluribus was named by Science as one of the top 10 scientific breakthroughs of 2019. Noam received his PhD from Carnegie Mellon University. 

About the Lecture:  The Katayanagi Lectures recognize the best and the brightest in the field of computer science and are presented by the School of Computer Science at Carnegie Mellon University in close cooperation with the Tokyo University of Technology (TUT). The lectures recognize both senior and junior talent.  The series were established through a gift from Japanese entrepreneur and education advocate, Mr. Koh Katayanagi, who founded TUT and other technical institutions in Japan over many multiple decades.  We are delighted to have TUT as partners.