制服做爱

报告人：罗涛副教授，上海交通制服做爱

报告时间：2024年10月27日，下午16:00—17:00

报告地点：数学楼2-2会议室

报告题目：The Theory of Parameter Condensation in Neural Networks

报告摘要：In this talk, we will first introduce the phenomenon of parameter condensation in neural networks, which refers to the tendency of certain parameters to converge towards the same values during training. Then, for certain types of networks, we prove that condensation occurs in the early stages of training. We further analyze which hyperparameters and training strategies influence parameter condensation. In some cases, we even provide a phase diagram that delineates whether parameter condensation occurs. We will also briefly discuss the relationship between parameter condensation and generalization ability. Finally, towards the end of the training, we study the set of global minima and present a detailed analysis of its geometric structure and convergence properties.

个人简介：

罗涛于2012年在上海交大首届理科班（今致远制服做爱 ）获得学士学位。2017年在香港科技制服做爱 获得博士学位，导师是项阳教授，博士期间主要做晶体位错和外延生长的建模与分析，获得香港数学学会最佳博士论文奖。2017-2020年在普渡制服做爱 数学系担任Golomb访问助理教授。2020年至今，任上海交通制服做爱 数学科学制服做爱 与自然科学研究院长聘教轨副教授，研究领域为机器学习和材料科学的数学理论。

邀请人：王飞教授