I am a 5th-year Ph.D. student in the Department of Computer Science, The University of Hong Kong. I work at Computer Graphics Laboratory under the guidance of Prof. Wenping Wang.
I spent four months at New York University working with Prof. Daniele Panozzo . Prior to that, I had a wonderful time visiting Prof. Christian Theobalt at Max-Planck-Institute for Informatics, Saarbrucken, Germany. I also spent great time at University College London under the supervision of Prof. Niloy J. Mitra.
Before starting my PhD, I obtained a Bachelor's Degree in the Department of Computer Science and Technology, Huazhong University of Science and Technology in 2014 and supervised by Prof. Hai Jin.
My research interests include 3D reconstruction, video synthesis, human performance capture, etc.
ACM Transactions on Graphics, to be presented at SIGGRAPH 2019[Project page] [Paper] [Code(Coming soon)] [Video] [Media] [bibtex]
Synthesizing realistic videos of humans using neural networks has been a popular alternative to the conventional graphics-based rendering pipeline due to its high efficiency. Existing works typically formulate this as an image-to-image translation problem in 2D screen space, which leads to artifacts such as over-smoothing, missing body parts, and temporal instability of fine-scale detail, such as pose-dependent wrinkles in the clothing. We are developing a novel human video synthesis method that approaches these limiting factors by explicitly disentangling the learning of time-coherent fine-scale details from the pose-dependent embedding of the human in 2D screen space.
Joint project with the Hong Kong Applied Science and Technology Research Institute (ASTRI) with a total budget of 500,000 HKD
Hong Kong, China
Hong Kong PhD Fellowship (HKPF) holder (Top 100 PhD students in Hong Kong)
Supervised by Prof. Wenping Wang.
Ranking: 1/329, GPA: 90.68/100
CCF (China Computer Federation) Top 100 Excellent Undergraduates
Won "Best Linpack" Award in International Supercomputer Competition 2013 (ISC'13, held in Germany)
Won "Best MIC Performance" Award in Asia Student Supercomputer Challenge 2013 (ASC'13, held in China)
The "Meritorious Winner" in Mathematical Contest in Modeling (MCM) 2013
Advised by Prof. Hai Jin.
New York, USA
Courant Institute of Mathematical Sciences
Visited Prof. Daniele Panozzo at New York University from Feb 2019 to June 2019.
Working on a project of free-view rendering of human motion reenactment.
3D Video and Vision-based Graphics Group
Visited Prof. Christian Theobalt at Max-Planck-Institute for Informatics from March 2018 to Jan 2019.
Completed the work "Neural Animation and Reenactment of Human Actor Videos" (TOG).
Extended the work above to joint learning of dynamic textures and rendering-to-video translation (To be submitted).
Smart Geometry Processing Group
Visited Prof. Niloy J. Mitra at UCL from Sept 2016 to Jan 2017, and from May 2017 to Nov 2017.
Completed the work "Image-based Reconstruction of Wire Art" (SIGGRAPH 2017).
Completed the work "CurveFusion: Reconstructing Thin Structures from RGBD Sequences" (SIGGRAPH Asia 2018).
The Computational Fabrication Group, MIT CSAIL
Department of Computer Science, Harvard University
Department of Automation, Tsinghua University
Baidu Research, Beijing
Department of Computer Science, University of British Columbia
SFU Visual Computing Workshop
School of Mathematical Sciences, University of Science and Technology of China
Department of Computer Science and Technology, Nanjing University
Department of Computer Science and Technology, South China University of Technology
TVCG, PG 2018, CAGD
Aug 2014 * Research Grants Council (RGC) in Hong Kong
2014 * CCF (China Computer Federation)
Jan 2013 * MCM Committee
Jul 2013 * HPCAC-ISC committee
Best Linpack Award for the highest score (8.455 Tflops with 3000 Watts), which created the new world record among student cluster challenges.
Apr 2013 * ASC Committee
Ministry of Education of China
2013, 2012, 2011