个人简历

Experience\r
Since 2019 Associate Professor, School of Software, Beihang University, Beijing, China.\r
2017 - 2019 Postdoctoral Researcher, Multimedia Laboratory (MMLab), The Chinese University of Hong Kong, Hong Kong, China, with Prof. Xiaogang Wang.\r
2015 - 2016 Research Assistant, BeingThere Centre, Institute for Media Innovation, Nanyang Technological University, Singapore, with Prof. Jianfei Cai.\r
\r
Education\r
2011 -2017 Mphil-Ph.D Degree, Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China, Supervised by Prof. King Ngi Ngan.\r
2007 - 2011 B.E. Degree, Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China.

研究领域

His research interests include computer vision, machine learning and multimedia, aiming at endowing machines with the capability to perceive, understand, reconstruct, and interact with the 3D visual world, with the following focuses recently:\r
\r
Data-driven models for extracting hierarchical 3D semantics, inferring semantical/geometrical relationships, and rendering high-fidelity 2D/3D contents, based on multi-modal signals (including 2D/3D vision, language, etc) and beyond.""

近期论文

Yinan He, Gengshi Huang, Siyu Chen, Jianing Teng, Wang Kun, Zhenfei Yin, Lu Sheng, Ziwei Liu, Yu Qiao, Jing Shao (2022). X-Learner: Learning Cross Sources and Tasks for Universal Visual Representation. European Conference on Computer Vision (ECCV).\r
\r
Chenjian Gao, Qian Yu, Lu Sheng, Yi-Zhe Song, Dong Xu (2022). SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Sampling. European Conference on Computer Vision (ECCV).\r
\r
Ziming Wang, Xiaoliang Huo, Zhenghao Chen, Jing Zhang, Lu Sheng, Dong Xu (2022). Improving RGB-D Point Cloud Registration by Learning Multi-scale Local Linear Transformation. European Conference on Computer Vision (ECCV).\r
\r
Daigang Cai, Lichen Zhao, Jing Zhang, Lu Sheng, Dong Xu (2022). 3DJCG: A Unified Framework for Joint Dense Captioning and Visual Grounding on 3D Point Clouds. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Oral Presentation.\r
\r
Buyu Li, Yongchi Zhao, Zhelun Shi, Lu Sheng (2022). DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformer. AAAI Conference on Artificial Intelligence (AAAI).\r
\r
Kaisiyuan Wang,, Lu Sheng, Shuhang Gu,, Dong Xu (2022). VPU: A Video-Based Point Cloud Upsampling Framework. IEEE Transactions on Image Processing (IEEE T-IP).\r
\r
Guanze Liu, Yu Rong, Lu Sheng (2021). VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Clouds. ACM International Conference on Multimedia (ACM MM), Oral Presentation.\r
\r
Xiaolei Wu, Zhihao Hu, Lu Sheng, Dong Xu (2021). StyleFormer: Real-time Arbitrary Style Transfer via Parametric Style Composition. IEEE/CVF International Conference on Computer Vision (ICCV).\r
\r
Lichen Zhao, Daigang Cai, Lu Sheng, Dong Xu (2021). 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds. IEEE/CVF International Conference on Computer Vision (ICCV).\r
\r
Kaisiyuan Wang,, Lu Sheng, Shuhang Gu,, Dong Xu (2021). Sequential Point Cloud Upsampling by Exploiting Multi-Scale Temporal Dependency. IEEE Transactions on Circuits and Systems for Video Technology (IEEE T-CSVT).\r
\r
Lichen Zhao, Jinyang Guo,, Dong Xu, Lu Sheng (2021). Transformer3D-Det: Improving 3D Object Detection by Vote Refinement. IEEE Transactions on Circuits and Systems for Video Technology (IEEE T-CSVT).\r
\r
Yinan He, Bei Gan, Siyu Chen, Yichun Zhou, Guojun Yin, Luchuan Song, Lu Sheng, Jing Shao, Ziwei Liu (2021). ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Oral Presentation.\r
\r
Bowen Cheng, Lu Sheng, Shaoshuai Shi, Ming Yang, Dong Xu (2021). Back-tracing Representative Points for Voting-based 3D Object Detection in Point Clouds. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Rui Su, Dong Xu, Lu Sheng, Wanli Ouyang (2021). PCG-TAL: Progressive Cross-Granularity Cooperation for Temporal Action Localization. IEEE Transactions on Image Processing (IEEE T-IP).\r
\r
Chi Ho Cheung, Lu Sheng, King Ngi Ngan (2021). Motion Compensated Virtual View Synthesis Using Novel Particle Cell. IEEE Transactions on Multimedia (IEEE T-MM).\r
\r
Yandan Yang, Lu Sheng, Xiaolong Jiang, Haochen Wang, Dong Xu, Xianbin Cao (2021). IncreACO: Incrementally Learned Automatic Check-out with Photorealistic Exemplar Augmentation. IEEE Winter Conference on Applications of Computer Vision (WACV).\r
\r
Lu Sheng, Junting Pan, Jiaming Guo, Jing Shao, Chen Change Loy (2020). High-Quality Video Generation from Static Structural Annotations. International Journal of Computer Vision (IJCV).\r
\r
Yuyang Qian, Guojun Yin, Lu Sheng, Zixuan Chen, Jing Shao (2020). Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues. European Conference on Computer Vision (ECCV).\r
\r
Ronghao Guo, Chen Lin, Chuming Li, Keyu Tian, Ming Sun, Lu Sheng, Junjie Yan (2020). Powering One-Shot Topological NAS with Stabilized Share-Parameter Proxy. European Conference on Computer Vision (ECCV).\r
\r
Minghua Liu, Lu Sheng, Sheng Yang, Jing Shao, Shi-Min Hu (2020). Morphing and Sampling Network for Dense Point Cloud Completion. AAAI Conference on Artificial Intelligence (AAAI).\r
\r
Lu Sheng, Dan Xu, Wanli Ouyang, Xiaogang Wang (2019). Unsupervised Collaborative Learning of Keyframe Detection and Visual Odometry Towards Monocular Deep SLAM. IEEE/CVF International Conference on Computer Vision (ICCV).\r
\r
Chufeng Tang, Lu Sheng, Zhao-Xiang Zhang, Xiaolin Hu (2019). Improving Pedestrian Attribute Recognition With Weakly-Supervised Multi-Scale Attribute-Specific Localization. IEEE/CVF International Conference on Computer Vision (ICCV).\r
\r
Zihao Wang, Xihui Liu, Hongsheng Li, Lu Sheng, Junjie Yan, Xiaogang Wang, Jing Shao (2019). CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrieval. IEEE/CVF International Conference on Computer Vision (ICCV).\r
\r
Bowen Dong, Lu Sheng (2019). Bags of tricks for learning depth and camera motion from monocular videos. Virtual Reality & Intelligent Hardware (VRIH).\r
\r
Fanzi Wu, Songnan Li, Tianhao Zhao, King Ngi Ngan, Lu Sheng (2019). Cascaded regression using landmark displacement for 3D face reconstruction. Pattern Recognition Letters (PRL).\r
\r
Junting Pan, Chengyu Wang, Xu Jia, Jing Shao, Lu Sheng, Junjie Yan, Xiaogang Wang (2019). Video Generation From Single Semantic Label Map. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Guojun Yin, Bin Liu, Lu Sheng, Nenghai Yu, Xiaogang Wang, Jing Shao (2019). Semantics Disentangling for Text-To-Image Generation. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Oral Presentation.\r
\r
Buyu Li, Wanli Ouyang, Lu Sheng, Xingyu Zeng, Xiaogang Wang (2019). GS3D: An Efficient 3D Object Detection Framework for Autonomous Driving. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Guojun Yin, Lu Sheng, Bin Liu, Nenghai Yu, Xiaogang Wang, Jing Shao (2019). Context and Attribute Grounded Dense Captioning. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Lu Sheng, Jianfei Cai, Tat-Jen Cham, Vladimir Pavlovic, King Ngi Ngan (2019). Visibility Constrained Generative Model for Depth-Based 3D Facial Pose Tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE T-PAMI).\r
\r
Yongcheng Liu, Lu Sheng, Jing Shao, Junjie Yan, Shiming Xiang, Chunhong Pan (2018). Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detection. ACM international conference on Multimedia (ACM MM).\r
\r
Guojun Yin, Lu Sheng, Bin Liu, Nenghai Yu, Xiaogang Wang, Jing Shao, Chen Change Loy (2018). Zoom-Net: Mining Deep Feature Interactions for Visual Relationship Recognition. European Conference on Computer Vision (ECCV).\r
\r
Chi Ho Cheung, King Ngi Ngan, Lu Sheng (2018). Spatio-Temporal Disocclusion Filling Using Novel Sprite Cells. IEEE Transactions on Multimedia (IEEE T-MM).\r
\r
Shuyang Sun, Zhanghui Kuang, Lu Sheng, Wanli Ouyang, Wei Zhang (2018). Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognition. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Yu Liu, Fangyin Wei, Jing Shao, Lu Sheng, Junjie Yan, Xiaogang Wang (2018). Exploring Disentangled Feature Representation Beyond Face Identification. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Lu Sheng, Ziyi Lin, Jing Shao, Xiaogang Wang (2018). Avatar-Net: Multi-scale Zero-Shot Style Transfer by Feature Decoration. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).\r
\r
Xihui Liu, Haiyu Zhao, Maoqing Tian, Lu Sheng, Jing Shao, Shuai Yi, Junjie Yan, Xiaogang Wang (2017). HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis. IEEE International Conference on Computer Vision (ICCV).