Smart Sensing and Perception in the AI Era

Speaker:
Dr. Jinwei Gu
R&D Executive Director
SenseBrain (aka SenseTime USA)

Abstract:
Smart sensing and perception refer to intelligent and efficient ways of measuring, modeling, and understanding of the physical world, which act as the eyes and ears of any AI-based system. Smart sensing and perception sit across the intersection of three related areas – computational imaging, representation learning, and scene understanding. Computational imaging refers to sensing the real world with optimally designed, task-specific, multi-modality sensors and optics which actively probes key visual information. Representation learning refers to learning the transformation from sensors’ raw output to some manifold embedding or feature spaces for further processing. Scene understanding includes both the low-level capture of a 3D scene of its physical properties, as well as high-level semantic perception and understanding of the scene. Advances in this area will not only benefit computer vision tasks but also result in better hardware, such as AI image sensors, AI ISP (Image Signal Processing) chips, and AI camera systems. In this talk, I will present several latest research results including high quality image restoration and accurate depth estimation from time-of-flight sensors or monocular videos, as well as some latest computational photography products in smart phones including under-display cameras, AI image sensors and AI ISP chips. I will also layout several open challenges and future research directions in this area.

Biography:
Jinwei Gu is the R&D Executive Director of SenseBrain (aka SenseTime USA). His current research focuses on low-level computer vision, computational photography, computational imaging, smart visual sensing and perception, and appearance modeling. He obtained his Ph.D. degree in 2010 from Columbia University, and his B.S and M.S. from Tsinghua University, in 2002 and 2005 respectively. Before joining
SenseTime, he was a senior research scientist in NVIDIA Research from 2015 to 2018. Prior to that, he was an assistant professor in Rochester Institute of Technology from 2010 to 2013, and a senior researcher in the media lab of Futurewei Technologies from 2013 to 2015. He serves as an associate editor for IEEE Transactions on Computational Imaging (TCI) and IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), an area chair for ICCV2019, ECCV2020, and CVPR2021, and industry chair for ICCP2020. He is an IEEE senior member since 2018. His research work has been successfully transferred to many products such as NVIDIA CoPilot SDK, DriveIX SDK, as well as super resolution, super night, portrait restoration, RGBW solution which are widely used in many flagship mobile phones.

Join Zoom Meeting:
https://cuhk.zoom.us/j/97322964334?pwd=cGRJdUx1bkxFaENJKzVwcHdQQm5sZz09

Enquiries: Ms. Karen Chan at Tel. 3943 8439