Machine Learning Seminar - Ke Li

— 3:00pm

Location:
In Person - Newell-Simon 3305

Speaker:
KE LI , Assistant Professor and Visual Computing Chair, School of Computing Science , Simon Fraser University
https://www.sfu.ca/~keli/

The Devil Is in the Gaps: How (Not) To Interpolate Between Discrete Points

What do diffusion models/flow matching, Gaussian splatting and efficient transformer architectures have in common? Under the hood, they all turn a discrete set of points into a function defined everywhere. In the case of diffusion models/flow matching, the points are training data points, and the function is the probability density. In the case of Gaussian splatting, the points are splat centres and the function is the volume density. In the case of efficient transformers, the points are keys used by attention and the function is the mapping from query to attention weights.  It turns out that how gaps between points are filled in is critical.

In this talk, I will show how seemingly innocent choices made in popular techniques give rise to profound consequences. Such choices make diffusion models/flow matching data-hungry and slow to sample from, Gaussian splats hard to move and edit, and hashing-based efficient transformers error-prone. To address these issues, I will give an overview of three methods my lab developed, Implicit Maximum Likelihood Estimation (IMLE), Proximity Attention Point Rendering (PAPR) and IceFormer, and show applications in few-shot image synthesis, trajectory prediction, visuomotor policy learning, novel view synthesis, 3D shape and albedo editing, scene interpolation and language modelling.  

— 

Ke Li is an Assistant Professor and Visual Computing Chair in the School of Computing Science at Simon Fraser University (SFU), where he directs the APEX Lab. Ke’s current research interests are on generative models, neural rendering, efficient transformers and reinforcement learning. Ke was previously a Research Scientist at Google and a Member of the Institute for Advanced Study (IAS) in Princeton, and received his Ph.D. from University of California, Berkeley and B.Sc. from the University of Toronto.

Add event to Google
Add event to iCal