讲座时间:2024年3月21日15:30
讲座地点:线上(腾讯会议:876-586-773)
联邦学习中的神经网络剪枝/Neural Network Pruning in Federated Learning
主讲人:Dapeng Oliver Wu 教授 ,IEEE Fellow
香港城市大学
讲座摘要:
Neural network pruning is an essential technique for reducing the size and complexity of deep neural networks, enabling large-scale models on devices with limited resources. However, existing pruning approaches heavily rely on training data for guiding the pruning strategies, making them ineffective for federated learning over distributed and confidential datasets. Additionally, the memory- and computation-intensive pruning process becomes infeasible for recourse-constrained devices in federated learning. To address these challenges, we propose FedTiny, a distributed pruning framework for federated learning that generates specialized tiny models for memory- and computing-constrained devices. This talk presents the design of FedTiny and demonstrates the effectiveness of FedTiny.
主讲人简介:
Dapeng Oliver Wu received Ph.D. in Electrical and Computer Engineering from Carnegie Mellon University, Pittsburgh, PA, in 2003. Currently, he is Yeung Kin Man Chair Professor of Network Science, at the Department of Computer Science, City University of Hong Kong. His research interests are in the areas of artificial intelligence, FinTech, communications, image processing, computer vision, signal processing, and biomedical engineering. He received the IEEE Circuits and Systems for Video Technology (CSVT) Transactions Best Paper Award for Year 2001, the Best Paper Award in GLOBECOM 2011, and the Best Paper Award in QShine 2006. He has served as Editor-in-Chief of IEEE Transactions on Network Science and Engineering. He was the founding Editor-in-Chief of Journal of Advances in Multimedia between 2006 and 2008. He has served as Technical Program Committee (TPC) Chair for IEEE INFOCOM 2012. He was elected as a Distinguished Lecturer by IEEE Vehicular Technology Society in 2016. He is an IEEE Fellow.