Seminar第2817讲 基于快速非精确梯度加速的稀疏过参数化求解算法

创建时间:  2025/03/24  谭福平   浏览次数:   返回

报告题目 (Title):Accelerating Sparse Over-parameterized Solvers via Fast Inexact Gradients(基于快速非精确梯度加速的稀疏过参数化求解算法)

报告人 (Speaker): 梁经纬 副教授(上海交通大学)

报告时间 (Time):2025年3月27日(周四) 9:00

报告地点 (Place):校本部GJ303

邀请人(Inviter):曾晓艳


报告摘要:Sparse regularization, such as l_1-norm, (over-lapping) group sparsity and low-rank, are widely used in data science and machine learning. Designing efficient numerical solvers for sparse regularization has been an extremely active research area since the new millennium. Recently, over-parameterized solvers such as VarPro [Poon & Peyre, 2023] have been particularly attractive due to its improved conditioning properties and ability to transform the original non-smooth optimization problem into a smooth one, enabling the possibilities of adopting high-order numerical schemes such as quasi-Newton methods. However, despite the fast global convergence behavior, such methods incur a high per iteration complexity. To circumvent this drawback, by an `approximated dimension reduction', in this talk I will introduce an inexact version of VarPro which can significantly reduce the per-iteration complexity. The error incurred at each step can be directly controlled and our inexact gradient approach is adaptive, thus allowing for significant acceleration without hurting convergence. The method works seamlessly with L-BFGS and substantially enhances the performance of VarPro. Numerical experiments are provided for various sparse optimization problems.

上一条:Seminar第2818讲 大学数学课程思政理念与实践

下一条:Seminar第2816讲 黎曼希尔伯特问题简介

  版权所有 © 上海大学   沪ICP备09014157   沪公网安备31009102000049号  地址:上海市宝山区上大路99号    邮编:200444   电话查询
 技术支持:上海大学信息化工作办公室   联系我们