宋利，男，上海交通大學教授、博士生導師，現任圖像通信與網路工程研究所副所長，兼任人工智慧研究院及未來媒體網路協同創新中心雙聘教授。其研究方向為媒體智慧型信號處理、媒體通信與計算系統、生成式視覺AI，主持國家重點研發計畫、國家自然科學基金等國家級科研項目10餘項，發表學術論文300餘篇，授權發明專利50餘項，獲軟體著作權5項。
其研究成果獲國家科技進步二等獎（2015）、上海市科技進步一等獎（2011）、上海市技術發明一等獎（2011）、國際會議優秀論文獎（VCIP 2016、WCSP 2010），並獲日本大川基金研究獎（2013）、國際競賽Grand Challenge獎（ICME 2017、2020）及TVP騰訊雲最具價值專家（2019、2020）等行業榮譽。擔任IEEETransactions on Broadcasting特邀編委、Springer Multidimensional Systems and Signal Processing編委，系IEEE高級會員，曾擔任LiveVideoStackCon上海峰會主席（2019、2020）。現任中國視頻用戶體驗聯盟副秘書長及標準組組長，參與中國超高清產業聯盟、中國智慧家庭產業聯盟、上海市超高清產業聯盟、上海市物聯網協會、上海市信息家電協會等多個行業組織技術諮詢工作。其團隊在AI視頻編碼、AIGC技術領域取得關鍵進展，相關成果套用於無人機視頻傳輸、超高清視頻及智慧監控等場景。
基本介紹
- 中文名：宋利
- 國籍：中國
- 民族：漢族
- 職務：教授，博士生導師
個人簡介,研究領域,獲獎情況,教學授課,科研項目,學術兼職,著作專利,重要論文,
個人簡介
宋利，教授，博士生導師，上海交通大學圖像通信與網路工程研究所副所長，人工智慧研究院、未來媒體網路協同創新中心雙聘教授，中國視頻用戶體驗聯盟副秘書長及標準組組長。研究方向是媒體智慧型信號處理、媒體通信與計算系統，主持國家級科研項目10餘項，發表學術論文200餘篇，授權發明專利40項，軟體著作權5項。獲國家科技進步二等獎(2015)、上海市科技進步一等獎(2011)、上海市技術發明一等獎(2011)、日本大川基金研究獎(2013)、國際會議優秀論文獎(VCIP2016, WCSP2010)、國際競賽獎(ICME 2017, 2020)、TVP騰訊雲最具價值專家(2019, 2020)。擔任IEEE Trans on Broadcasting特邀編委, Springer Multidimensional Systems and Signal Processing編委、是IEEE 高級會員、LiveVideoStackCon(2019,2020)上海峰會主席、中國智慧家庭產業聯盟、中國超高清產業聯盟、上海市超高清產業聯盟、上海市物聯網協會、上海市信息家電協會的技術諮詢專家。
研究領域
視頻編碼、圖像處理、多媒體系統、計算機視覺及人工智慧
1. 新型視頻編碼(Next Generation Video Coding)
-- 視覺感知編碼最佳化
-- AI驅動的視頻編碼
-- 低延遲彈性編碼
2. 視頻處理(Video Processsing )
-- Low-level Vision Problem
-- Video Enhancement & Experience Assessment
-- Computational Camera and Display
3. 視頻生成(Video Making)
-- GAN for Vision Modeling
-- DL for Video Synthesis
-- AI for Video Rendering
獲獎情況
1、國家科技進步二等獎(排名第5)，2015
2. 上海市科技進步一等獎（排名第3），2011
3. 上海市科技發明一等獎（排名第5），2011
4. 日本大川財團研究獎，2013
5. IEEE VCIP Top10%論文獎，2016
6. 國際會議WCSP最佳論文獎，2010
7. IEEE ICME Grand Challenge獎，2017、2020
8. 騰訊雲TVP、聲網TVP
教學授課
Spring, 2011-2017(SJTU), Graduate Students(研究生), F034606: Visual Computing Theory and Engineering
Spring, 2013-2017(SJTU), Undergraduate(本科),EE346: Introduction to Image Processing（數字圖像處理）
Spring, 2020(SJTU), Undergraduate(本科),EE450: Multimedia Communication Systems and Applications多媒體通信系統與實現）
科研項目
1、國家重點研發計畫，課題負責人，媒體融合架構與編碼傳送(2019YFB1802701)，1131萬元，2020.1-2022.12
2、國家自然科學基金，課題負責人，延遲約束的視頻編碼並行最佳化研究(61671296), 60萬，2017.1-2020.12
3、教育部-中移動聯合，課題聯合負責人，5G新文娛數位化體驗(MCM20180702), 550萬，2019.9-2022.9
4、國家科技部863，課題負責人，高端視頻編碼與網路適配技術研究(2012AA011703)，634萬，2012.12-2014.12
5、橫向項目：華為、谷歌、上汽、中興、騰訊、中電信、中移動、位元組跳動等，>600萬, 2018.1-至 今
學術兼職
IEEE Trans on Broadcasting特邀編委
Springer Multidimensional Systems and Signal Processing編委
IEEE ICME, VCIP, ICIP等會議Session/Review Chairs
LiveVideoStackCon(2019,2020)上海峰會主席
中國智慧家庭產業聯盟技術諮詢專家
中國超高清產業聯盟技術諮詢專家
上海市超高清產業聯盟技術諮詢專家
上海市物聯網協會技術諮詢專家
上海市信息家電協會的技術諮詢專家
著作專利
Book Chapter:
1. Y. Xu, X. Yang, Li Song, L. Traversoni and W. Lu, “QWT: Retrospective and New Applications”, in Geometric Algebra Computing in Engineering and Computer Science, Springer Bayro-Corrochano, Eduardo Jose; Scheuermann, Gerik (Eds.), 2010, XVI, 524 p, ISBN: 978-1-84996-107-3.
2. J. Hu, Y. Fang, N. Ling, and Li Song, “Cloud-based Large-scale Topic Modeling for Multimedia Analysis and Retrieval”. In Cloud Computing and Digital Media: Fundamentals, Techniques, and Applications, Chapman and Hall/CRC, 2015.
3. J. Feng, X. Huo, Li Song, X. Yang and W. Zhang, “Image Nonnegative Factorization: Formulation and Numerical Strategies”, In Master Lectures on Mathematics, TSIMF Conference Book, International Press(USA) & Higher Education Press(China), 2014.
Patents:
1. 宋利，馬悅，黃琰，一種適用於視頻切片的碼率控制比特分配方法，ZL201810418031.7
2. 解蓉，魏如君，宋利，一種幀內預測性能提升編碼方法，ZL201610726981.7
3. 解蓉，白立勛，宋利，張文軍，一種適用於高動態範圍的碼率控制比特分配方法，ZL201711207765.2
4. 宋利，黃琰，楊小康，安平，基於蒙特卡洛法馬爾可夫鏈的編碼參數自適應調整方法，ZL 201810424004.0
5. 宋利, 謝劍鋒, 解蓉, 一種時域依賴的碼率控制比特分配方法, ZL201510483514.1
6. 宋利，沐方順，楊小康, 一種加速HEVC編碼速度的級聯方法, ZL201410719598.X
7. 宋利，才琦，一種HEVC解碼器並行任務劃分方法，ZL201410077419.7
8. 宋利，趙亞男，王嘉，一種基於先入先出佇列的HEVC細粒度並行預測方法，ZL201410005285.8
9. 宋利, 周強, 張文軍, 基於關鍵幀超解析度重建的視頻編碼系統, ZL201010292294.1
10. 宋利, 駱政屹, 鄭世寶, 基於預測殘差自適應調整的視頻編碼系統, ZL201010203917.3
11. 宋利，駱政屹，鄭世寶，王嘉，一種改進的帶有預測殘差調整的視頻編碼方法，ZL201210462123.8
12. 宋利，駱政屹，基於Raptor 碼的多媒體數據非均等差錯保護方法, ZL201310289535.0
13. 宋利，駱政屹，王沛，基於碼率切換的多媒體信源信道聯合編碼傳輸方法，ZL201110215414.2
14. 宋利，朱雨桐，解蓉，張文軍，一種基於視頻內容及聚類分析的壓縮碼率預測方法，ZL201610378960.0
15. 宋利，張瑋，楊小康，基於視頻空間和時間信息的視頻質量及壓縮碼率估計方法，ZL201410029987.X
16. 宋利, 趙成，解蓉，一種基於代理伺服器的DASH流媒體直播方法，ZL201610697879.9
17. 解蓉, 魏如君，宋利，一種幀內預測性能提升編碼方法，ZL201610726981.7
18. 宋利，白立勛，解蓉，一種基於顯著性的碼率控制比特分配方法，ZL201610778561.3
19. 宋利，張翰，楊小康，用於視頻編碼分數像素插值的卷積神經網路的構建方法，ZL201711207766.7
20. 宋利，張智峰，解蓉，陳立，基於卷積神經網路的視頻幀率上變換方法及系統，ZL201811059317.7
21. 宋利，張智峰，解蓉，陳立，基於循環卷積神經網路的視頻幀率上變換方法及系統，ZL201811059369.4
22. 宋利，許經緯，解蓉，張文軍，基於深度學習的無監督視頻分割方法, ZL201711004135.5
23. 宋利，陳欣苑，楊小康，基於深度遞歸神經網路的視頻去噪方法，ZL201610729038.1
24. 宋利，劉彥凱，解蓉，張文軍，一種基於內容分類的視頻模糊度檢測人眼視覺修正方法, ZL201710874527.0
25. 宋利，陳忱，一種用於無參考圖像質量評價的特徵構建方法，ZL201410029622.7
26. 宋利，藍勁鵬，瞿暉，一種視頻抖動自動檢測方法 ，ZL201410318324.X
27. 宋利，童文靖，楊小康，基於深度學習的視頻鏡頭檢測方法, ZL201510332345.1
28. 宋利，瞿輝，基於稀疏度和保真度約束的視頻穩像方法, ZL201310046191.0
29. 宋利，薛耿劍，孫軍，基於稀疏性和平滑性的運動目標檢測方法，ZL201310029803.5
30. 宋利，劉兵，基於Harr-like特徵的文檔傾斜校正方法, ZL201210170270.8
31. 宋利, 薛耿劍, 孫軍, 基於線性回歸模型的目標檢測方法, ZL201110223892.8
32. 宋利, 徐振超，薛耿劍，基於訓練自適應增強和支持矢量機的目標識別方法, ZL201110099202.2
33. 宋利, 王嘉, 徐奕, 李鈾, 主從攝像機系統的全自動標定方法, ZL201010139976.9
34. 徐奕, 宋利, 解蓉, 張文軍, 低複雜度的尺度自適應視頻目標跟蹤方法, ZL200810036762.1
35. 熊紅凱, 宋利, 孫軍等, 網路視頻編碼器多維尺度碼率控制方法, ZL200510026390.0
36. L. Liu, G. Li, N. Ling, J. Zheng, P. Zhang, Li Song, Reference pixel reduction for intra LM prediction, US patent, US9307237 B2, April 5, 2016.
37. Li Song, J. Xu and F. Wu, Adaptive Updates in Motion Compensated Temporal Filtering, US patent, US 8442108, May.14.2014.
重要論文
H. Zhang, Li Song, L. Li, Z. Li, X. Yang, Compression Priors Assisted Convolutional Neural Network for Fractional Interpolation, IEEE Transactions on Circuits and Systems for Video Technology, accept.
X. Wang, E. Yang, D. He, Li Song, X. Yu, Rate Distortion Optimization: A Joint Framework and Algorithms for Random Access Hierarchical Video Coding, IEEE Transactions on Image Processing, accept.
Y. Dong, Li Song, R. Xie, W. Zhang, Real-time UHD video super-resolution and transcoding on heterogeneous hardware, Journal of Real-Time Image Processing, 2019, Vol.9 pp 1–17.
X. Chen, Chang Xu, X. Yang, Li Song, and D. Tao, “Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer,” IEEE Trans on Image Processing, vol. 28, no. 2, pp.546-559, 2019.
B. Wang, G. Chen, L. Fu, Li Song, X. Wang, “DRIMUX: Dynamic Rumor Influence Minimization with User Experience in Social Networks,” IEEE Transactions on Knowledge and Data Engineering, vol.29 , no.10, pp.2168-2181, 2017.
X. Lu, Li Song, R. Xie, X. Yang and W. Zhang, “Deep Binary Representation For Efficient Image Retrieval, ” Advances in Multimedia, 2017
Y. Zhang, L. Li, Li Song, R. Xie, W. Zhang, FACT: Fused Attention for Clothing Transfer with Generative Adversarial Networks, 2020 AAAI Conference on Artificial Intelligence, Feb 7-12, 2020, New York, USA.
S. Yu, X. Tong, Y. Huang, R. Xie and Li Song, Learning-based Quality Enhancement for Scalable Coded Video over Packet Lossy Networks, 2020 IEEE International Conference on Multimedia and Expo (ICME2020), 6-10 July 2020，London, United Kingdom,Virtual
J. Ling, H. Xue, Li Song, Shuhui Yang, Rong Xie, Xiao Gu, Toward Fine-grained Facial Expression Manipulation, 16th European Conference on Computer Vision(ECCV2020), 23-28 August 2020, Online
S. Peng, Li Song, J. Ling, R. Xie, etc., A Deep Tracking and Segmentation Approach for Soccer Videos Visual Effects, The 3rd Chinese Conference on Pattern Recognition and Computer Vision(PRCV 2020), 2020,10.16-18, Nanjing, China
X. Wang, Z. Luo, P. Li, Li Song, Learning Based Estimation of Video Coding Distortion, IEEE International Symposium on Circuits and Systems (ISCAS2020) ,virtual event during 11-14 October 2020
H. Xue, J. Ling, Li Song, R. Xie, W. Zhang, Realistic Talking Face Synthesis with Geometry-aware Feature Transformation, IEEE International Conference on Image Proceesing (ICIP2020), Oct.25-28, Ubited Arab Emirates, online event.
Z. Yang, Li Song, Rong Xie, Wenjun Zhang, etc., TSGAN: A Two-Stream Genrative Adversarial Network for Biit-depth Expansion, IEEE Symposium on Broadband Multimedia Systems and Broadcasting(BMSB 2020), 26-29, October, online
Z. Yang, Y. Dong, Li Song, R. Xie, etc., Native Resolution Detection for 4K-UHD Videos, IEEE Symposium on Broadband Multimedia Systems and Broadcasting(BMSB 2020), 26-29, October, online
J. Wu, R. Xie, Li Song, B. Liu, Deep Feature Guided Image Retargeting, 2019 IEEE International Conference on Visual Communications and Image Processing(VCIP 2020), Dec.1-4, 2019, Sydney, Australia.
Z. Yang, T. He, Li Song, R. Xie, X. Gu, An Improved QoE Evaluation Model for HTTP Adaptive Streaming, 2019 IEEE International Conference on Visual Communications and Image Processing(VCIP 2020), Dec.1-4, 2019, Sydney, Australia.
C. Zhu, Li Song, R. Xie, J. Han, Y. Xu, JND-based Perceptual Rate Distortion Optimization for AV1 Encoder, IEEE Picture Coding Symposium(PCS2019) , Ningbo, China, Nov.12-15, 2019.
Y. Huang, Li Song, E. Izquierdo, CNN Accelerated Intra Video Coding, Where Is the Upper Bound?, IEEE Picture Coding Symposium(PCS2019), Ningbo, China, Nov.12-15, 2019.
Y. Xu, S. Ning, R. Xie, Li Song, GAN Based Multi-exposure Inverse Tone Mapping, IEEE ICIP 2019, Taipei, Taiwan, Sep.22-25, 2019.
H. Zhang, L. Li, Li Song, X. Yang, Z. Li, Advanced CNN Based Motion Compensation Fractional Interpolation, IEEE ICIP 2019, Taipei, Taiwan, Sep.22-25, 2019.
Y. Xu, Li Song, R. Xie and W. Zhang, Deep Video Inverse Tone Mapping, IEEE International Conference on Multimedia Big Data (BigMM), Singapore, Sep. 11-13, 2019.
X. Li, S. Wang, C. Zhu, Li Song, R. Xie and W. Zhang, Viewport Prediction for Panoramic Video with Multi-CNN, IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Jeju, South Korea, June 5-7th, 2019.
X. Wu, X. Li, X. Tong, R. Xie, Li Song, Reinforcement Learning Based Adaptive Bitrate Algorithm for Transmitting Panoramic Videos, IEEE International Symposium on Circuits and Systems(ISCAS), Sapporo, Hokkaido, Japan, May 26-29, 2019.
Z. Luo, Y. Huang, X. Wang, R. Xie and Li Song, VMAF Oriented Perceptual Optimization for Video Coding, IEEE International Symposium on Circuits and Systems(ISCAS), Sapporo, Hokkaido, Japan, May 26-29, 2019.
Z. Ma, S. Yu, Y. Huang, R. Xie, Li Song, An improved Real-Time Video Communication System, IEEE International Conference on Visual Communications and Image Processing (VCIP), Taiwan, China, Dec 12-17, 2018
Y. Luo, X. Liu, C. Zhu, R. Xie, Li Song, Rate-mixed HEVC Tile based 360 Video Streaming System, IEEE International Conference on Visual Communications and Image Processing (VCIP), Taiwan, China, Dec 12-17, 2018
Z. Zhang, Li Song, R. Xie, L. Chen, Video Frame Interpolation Using Recurrent Convolutional Layers, IEEE International Conference on Multimedia Big Data (BigMM), Sep.13-16, 2018, Xian, China.
Z. Zhang, L. Chen, R. Xie, Li Song, Frame Interpolation via Refined Deep Voxel Flow, IEEE International Conference on Image Processing (ICIP), October 7-10, 2018, Athens, Greece.
J. Tang, Z. Luo, R. Xie, Y. Huang, Li Song, GPU Based Motion-Compensated Frame Interpolation Acceleration for Future Video Coding, IEEE International Conference on Image Processing(ICIP), October 7-10, 2018, Athens, Greece.
Y. Ma, Y. Huang, R. Xie, Li Song, A Segment Constraint ABR Algorithm for HEVC Encoder, The 13th IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), June 6-8, 2018, Valencia, Spain.
Y. Dong, Li Song, R. Xie, W. Zhang, A Generic Distributed Scheduling Algorithm for Frame Rate Up Convert Video Transcoding, The 13th IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), June 6-8, 2018, Valencia, Spain.
Y. Huang, Li Song, R. Xie, Z. Luo, X. Wang, An MCMC Based Efficient Parameter Selection Model for x265 Encoder, IEEE International Symposium on Circuits and Systems(ISCAS) , Florence, Italy, May 27-30, 2018
H. Wang, Li Song, R. Xie, Z. Luo, X. Wang, Masking Effects Based Rate Control Scheme for High Efficiency Video Coding, IEEE International Symposium on Circuits and Systems(ISCAS) , Florence, Italy, May 27-30, 2018
S. Ning, H. Xu, Li Song, R. Xie, W. Zhang, Learning an Inverse Tone Mapping Network with a Generative Adversarial Regularizer, IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP), April 15-20, 2018, Calgary, Alberta, Canada.
Y. Dong, X. Zhang, Y. Zhao, Li Song, A Containerized Media Cloud for Video Transcoding Service, IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, USA, Jan.12-14, 2018.X.
B. Li, Li Song, R. Xie, W. Zhang, Weight-Based Bit Allocation Scheme for VR Videos in HEVC, IEEE International Conference on Visual Communications and Image Processing (VCIP), St. Petersberg, Florida, US, Dec 10-13, 2017
L. Bai, Li Song, R. Xie, L. Zhang, Z. Luo, Rate Control Model for High Dynamic Range Video,” IEEE International Conference on Visual Communications and Image Processing (VCIP), St. Petersberg, Florida, US, Dec 10-13, 2017
H. Zhang, Li Song, Z. Luo, X. Yang, Learning a Convolutional Neural Network for Fractional Interpolation in HEVC Inter Coding, International Conference on Visual Communications and Image Processing (VCIP), St. Petersberg, Florida, US, Dec 10-13, 2017
C. Li, Li Song, R. Xie, W. Zhang, CNN Based Post-Processing to Improve HEVC, IEEE International Conference on Image Processing(ICIP), Beijing, China, Sep.17-20, 2017.
X. Wang, Li Song, Z. Luo, R. Xie, Lagrangian Method Based Rate-Distortion Optimization Revisited For Dependent Video Coding, IEEE International Conference on Image Processing(ICIP), Beijing, China, Sep.17-20, 2017
Y. Liu, Li Song, X. Yang, R. Xie, W. Zhang, Review of recent ITU-T Parametric Models for Compressed Video Quality Estimation, Asia-Pacific Signal and Information Processing Association (APSIPA) ASC, Jeju, Korea, Dec.13-16, 2016.
J. Xie, Li Song, R. Xie, Z. Luo, M. Chen, A novel parallel friendly rate control scheme for HEVC, Asia-Pacific Signal and Information Processing Association (APSIPA) ASC, Jeju, Korea, Dec.13-16, 2016.
H. Zhang, Li Song, X. Yang, Z. Luo, Evaluation of Beyond-HEVC Entropy Coding Methods for DCT Transform Coefficients, IEEE International Conference on Visual Communications and Image Processing (VCIP), Chengdu, China, Nov.27-30, 2016.
J. Xu, Li Song, R. Xie, Shot Boundary Detection Using Convolutional Neural Networks, IEEE International Conference on Visual Communications and Image Processing (VCIP), Chengdu, China, Nov.27-30, 2016.
M. Wang, Li Song, X. Yang, C. Luo, A Parallel Fusion RNN-LSTM Architecture for Image Caption Generation, IEEE International Conference on Image Processing(ICIP), Phoenix, Arizona, USA, Sep.25-28,2016
L. Song, Y. Liu, X. Yang, G. Zhai, R. Xie, W. Zhang, The SJTU HDR Video Sequence Dataset,”International Conference on Quality of Multimedia Experience(QoMEX2016), June 6-8, 2016, Lisbon, Portugal
X. Chen, Li Song, X. Yang, Deep recurrent neural networks for video denoising, Applications of Digital Image Processing, SPIE Conference, Aug.28-Sep.1, 2016, San Diego, CA, USA.
