报告题目：Revisit Fast Algorithms for Convolutional Neural Networks

报 告 人 ：Dr. Zhen Jia，AWS AI, Amazon

报告时间：2019年12月16日下午13:30

报告地点：中心校区 物理楼345讲学厅

报告摘要：As convolutional neural network (ConvNet) regained its popularity, several fast approaches were proposed to speed up the computation of its most time-consuming convolutional layers. Recently, it has been demonstrated that Winograd based convolution can greatly reduce the computation complexity of a convolution. A common belief is that Winograd based algorithms should be faster than FFT-based ones, which were the most frequently used methods to reduce the computation before Winograd proposed.

In this talk, I will first present our work on optimizing the Winograd based convolution. Our implementation achieves high hardware utilization through a series of optimizations and runs on average more than 3x faster than other state-of-the-art CPU implementations on the benchmarked layers. Then, I will revisit  FFT. We propose a performance model based on the idea of Roofline model to analyze and compare the performance of FFT and Winograd base convolutions on modern processors. To validate the predictions of our model, we also implement FFT based convolutions with the same optimization methods used in Winograd. The results of our experiments verify our model's prediction and demonstrate that Winograd is not always faster than FFT convolution.

报告人简介： Zhen Jia is an applied scientist in the AWS AI team of Amazon, CA, USA. Before joining Amazon. He was a Postdoctoral Research Associate at Princeton University in Computer Science Department. His research interests include convolutional neural network accelerating, workload characterization, benchmarking, and performance optimization at system level. He received the Ph.D degree from Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS). He has published over 30 papers in top computer system conferences and journals like HPCA, PPoPP, ICS, PACT, TPDS, etc. His publications have been cited 1,100+ times to date.

主办单位：

36365线路检测中心

中国声学学会物理声学分会、检测声学分会

高等学校计算物理研究会

吉林省计算物理学会