GRADUATE STUDENT SEMINAR: Implicit Biases of Stochastic Gradient Descent, Alexandru Damian

Tue, Oct 25, 2022, 12:30 pm

Title: Implicit Biases of Stochastic Gradient Descent

Abstract: Deep Learning relies on the ability of stochastic gradient descent (SGD) to navigate high-dimensional non-convex loss landscapes and return minimizers which generalize to unseen data. However, this process remains poorly understood. I will present two recent results which attempt to explain the generalization ability of SGD by proving that SGD has a strong preference for "flatter" minimizers which generalize better.

Location: 
Fine Hall 214
Event category: 

Upcoming Events

ANALYSIS OF FLUIDS AND RELATED TOPICS: Turbulent solutions of fluid equations: Alexey Cheskidov, University of Illinois at Chicago

PACM Colloquium, Prof. Lin Lin, UC Berkeley University

Mon, Feb 6, 2023, 4:30 pm
Location: 214 Fine Hall

ANALYSIS OF FLUIDS AND RELATED TOPICS: Kevin Zumbrun, Indiana University

Thu, Feb 9, 2023, 3:00 pm
Location: Fine Hall 314