MSCS Thesis Defense - Nabe Efe Çekirge

— 1:00pm

Location:
In Person - Gates Hillman 4405

Speaker:
NABE EFE ÇEKIRGE, Master's Student, Computer Science Department, Carnegie Mellon University

Linear Sketches for Geometric LP-Type Problems

LP-type problems such as the Minimum Enclosing Ball (MEB), Linear Support Vector Machine (SVM), Linear Programming (LP), and Semidefinite Programming (SDP) are fundamental combinatorial optimization problems, with many important applications in machine learning applications such as classification, bioinformatics, and noisy learning. We study LP-type problems in several streaming and distributed big data models, giving ϵ-approximation linear sketching algorithms with a focus on the high accuracy regime with low dimensionality d, that is, when d < (1 / ε)0.999. Our main result is an O(ds) pass algorithm with O ( s ( √d / ε )3d/s) ⋅ poly (d, log (1/ε)) space complexity, for any parameter s ∈ [1, d log (√d / ε)], to solve ϵ-approximate LP-type problems of O(d) combinatorial and VC dimension. Notably, by taking s = d log (√d / ε), we achieve space complexity polynomial in d and polylogarithmic in 1 / ϵ, presenting exponential improvements in 1 / ϵ over current algorithms. We complement our results by showing lower bounds of (1 / ε)Ω(d) for any 1-pass algorithm solving the (1 + ε)-approximation MEB and linear SVM problems, further motivating our multi-pass approach.  

Thesis Committee

David Woodruff (Chair)
Richard Peng

Additional Information