CMU FLAME Center Seminar - Nicholas Carlini April 18, 2025 12:30pm — 2:00pm Location: In Person and Virtual - ET - Tepper Building 1403 and Zoom Speaker: NICOLAS CARLINI , Research Scientist, Anthropic https://nicholas.carlini.com/ Computer Security in the Age of Large Language Models In ten years Large Language Models (LLMs) have grown from something that can sometimes spell some words correctly, to something that can solve PhD level math problems and write code at the level of competitive programmers. What does this mean for security? In this talk I first discuss one attempt at studying to what extent LLMs are capable of performing challenging research-level security tasks. As it turns out, they're not very good at this yet. So then I consider a second question: what could LLMs do to change security today? I argue there are many domains where even the capabilities of current models would more than suffice to fundamentally alter the economics of how attacks are performed and monetized. Finally, I conclude with some thoughts looking towards the future. — Nicholas Carlini is a research scientist at Anthropic studying what bad things you could do with, or do to, language models. Broadly his work is at the intersection of machine learning and computer security, and has received best paper awards from USENIX Security, ICML, and IEEE S&P. He received his PhD from UC Berkeley under David Wagner. In Person and Zoom Participation. See announcement. Event Website: https://www.cmu.edu/flame/events/index.html Add event to Google Add event to iCal