VASC Seminar - Hong-Xing “Koven” Yu

— 4:30pm

Location:
In Person - Newell-Simon 4305

Speaker:
HONG-XING "KOVEN" YU , Ph.D. Candidate, Computer Science Department, Stanford University
https://kovenyu.com/

Generating a Physical World

Generating an interactive, enlivened, and physical world enables a wide range of applications in entertainment, embodied AI, education, and creative designs. Recent image/video models have shown promise in producing realistic visuals, yet they operate purely at the pixel level and lack underlying physical grounding, leading to failures in physical fidelity and user interactivity. In this talk, I’ll introduce our recent efforts in physical world generation by grounding pixel models onto physical models. This methodology inherently incorporates physical world knowledge about 3D spatial structures and dynamics, simultaneously acquiring visual realism, physical fidelity, and user interactivity. I’ll showcase how this methodology is applied to enable fast generation of diverse worlds, with which users can interact via 3D actions. 

— 

Hong-Xing “Koven” Yu is a 5th-year PhD candidate at the Computer Science Department of Stanford University, advised by Prof. Jiajun Wu. His research interest centers around how AI can understand and generate the physical world. He is a recipient of the SIGGRAPH Asia Best Paper Award, the Stanford SoE Fellowship, the Qualcomm Innovation Fellowship, and the Meshy Fellowship, and a finalist of the NVIDIA Fellowship, the Meta Fellowship, the Jane Street Fellowship, and the Roblox Fellowship.

Add event to Google
Add event to iCal