Heming Zhu 朱鹤鸣

I am currently a final-year PhD student (since 2022) at the Max Planck Institute for Informatics in the Visual Computing and Artificial Intelligence department, supervised by Dr. Marc Habermann and Prof. Christian Theobalt.

I received my M.Sc. (2020) and B.Sc. (2017) in Computer Science and Technology from Zhejiang University. Before joining MPI, I was a research assistant at the GAP Lab at The Chinese University of Hong Kong, Shenzhen, supervised by Prof. Xiaoguang Han.

*Joint First Author, #Corresponding Author

@misc{zhu2026mua,
  title={MUA: Mobile Ultra-detailed Animatable Avatars},
  author={Zhu, Heming and Sun, Guoxing and Habermann, Marc},
  year={2026},
  eprint={2604.18583},
  archivePrefix={arXiv},
  primaryClass={cs.CV},
  url={https://arxiv.org/abs/2604.18583},
}

@article{zhu2025uma,
  title={UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment},
  author={Zhu, Heming and Sun, Guoxing and Theobalt, Christian and Habermann, Marc},
  journal={arXiv preprint arXiv:2506.01802},
  year={2025}
}

*Joint First Author, #Corresponding Author

GIGA: Generalizable Sparse Image-driven Gaussian Avatars

Anton Zubekhin, Heming Zhu, Paulo Gotardo, Thabo Beeler, Marc Habermann, Christian Theobalt#

3DV, 2026

project page paper bibtex

@article{zubekhin2025giga,
  title={GIGA: Generalizable Sparse Image-driven Gaussian Humans},
  author={Zubekhin, Anton and Zhu, Heming and Gotardo, Paulo and Beeler, Thabo and Habermann, Marc and Theobalt, Christian},
  year={2025},
  journal={arXiv},
  eprint={2504.07144},
}

EVA: Expressive Virtual Avatars from Multi-view Videos

Hendrik Junkawitsch, Guoxing Sun, Heming Zhu, Christian Theobalt, Marc Habermann#

Siggraph, 2025

project page paper bibtex

@article{junkawitsch2025eva,
  title={EVA: Expressive Virtual Avatars from Multi-view Videos},
  author={Junkawitsch, Hendrik and Sun, Guoxing and Zhu, Heming and Theobalt, Christian and Habermann, Marc},
  booktitle={SIGGRAPH 2025 Conference Papers},
  pages={1--11},
  year={2025}
}

DUT: Real-time Free-view Human Rendering from Sparse-view RGB Videos using Double Unprojected Textures

Guoxing Sun, Rishabh Dabral, Heming Zhu, Pascal Fua, Christian Theobalt, Marc Habermann#

CVPR, 2025

project page paper bibtex

@InProceedings{sun2025real,
  title={Real-time Free-view Human Rendering from Sparse-view RGB Videos using Double Unprojected Textures},
  author={Sun, Guoxing and Dabral, Rishabh and Zhu, Heming and Fua, Pascal and Theobalt, Christian and Habermann, Marc},
  year={2025},
  month={June},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
}

TEDRA: Text-based Editing of Dynamic and Photoreal Actors

Basavaraj Sunagad, Heming Zhu*, Mohit Mendiratta*, Adam Kortylewski, Christian Theobalt, Marc Habermann#

3DV, 2025

project page paper bibtex

@misc{sunagad2024tedra,
  title={TEDRA: Text-based Editing of Dynamic and Photoreal Actors},
  author={Sunagad, Basavaraj and Zhu, Heming and Mendiratta, Mohit and Kortylewski, Adam and Theobalt, Christian and Habermann, Marc},
  year={2024},
  eprint={2408.15995},
  archivePrefix={arXiv},
  primaryClass={cs.CV},
  url={https://arxiv.org/abs/2408.15995},
}

TriHuman: A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis

Heming Zhu, Fangneng Zhan, Christian Theobalt, Marc Habermann#

ACM Transactions on Graphics (ToG), 2024 (presented at Siggraph Asia 2024)

project page paper data code bibtex

@article{zhu2024trihuman,
  author={Zhu, Heming and Zhan, Fangneng and Theobalt, Christian and Habermann, Marc},
  title={TriHuman: A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis},
  year={2024},
  publisher={Association for Computing Machinery},
  address={New York, NY, USA},
  issn={0730-0301},
  url={https://doi.org/10.1145/3697140},
  doi={10.1145/3697140},
  journal={ACM Trans. Graph.},
  month=sep
}

ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering

Haokai Pang*, Heming Zhu*, Adam Kortylewski, Christian Theobalt, Marc Habermann#

CVPR, 2024

project page video paper code data bibtex

@InProceedings{Pang_2024_CVPR,
  author={Pang, Haokai and Zhu, Heming and Kortylewski, Adam and Theobalt, Christian and Habermann, Marc},
  title={ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  month={June},
  year={2024},
  pages={1165-1175}
}

SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modeling

Zhongjin Luo, Dong Du, Heming Zhu, Hongbo Fu, Xiaoguang Han#

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023

project page paper bibtex

@article{luo2023sketchmetaface,
  author={Luo, Zhongjin and Du, Dong and Zhu, Heming and Yu, Yizhou and Fu, Hongbo and Han, Xiaoguang},
  title={SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modeling},
  journal={IEEE Transactions on Visualization and Computer Graphics},
  year={2023}
}

Registering Explicit to Implicit: Towards High-Fidelity Garment Mesh Reconstruction from Single Images

Heming Zhu, Lingteng Qiu, Yuda Qiu, Xiaoguang Han#

CVPR, 2022

project page paper bibtex

@InProceedings{Zhu_2022_CVPR,
  title={Registering Explicit to Implicit: Towards High-Fidelity Garment Mesh Reconstruction from Single Images},
  author={Zhu, Heming and Qiu, Lingteng and Qiu, Yuda and Han, Xiaoguang},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  month={June},
  year={2022},
  pages={3845-3854}
}

SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design

Zhongjin Luo, Jie Zhou, Heming Zhu, Dong Du, Xiaoguang Han#, Hongbo Fu

User Interface Software and Technology (UIST), 2021

project page paper bibtex

@inproceedings{luo2021simpmodeling,
  title={SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design},
  author={Luo, Zhongjin and Zhou, Jie and Zhu, Heming and Du, Dong and Han, Xiaoguang and Fu, Hongbo},
  booktitle={The 34th Annual ACM Symposium on User Interface Software and Technology},
  pages={854--863},
  year={2021}
}

Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images

Heming Zhu*, Yu Cao*, Hang Jin*, Weikai Chen, Dong Du, Zhangye Wang, Shuguang Cui, Xiaoguang Han#

ECCV, 2020 (oral, top 2%)

project page V2 project page V1 paper data bibtex

@inproceedings{zhu2020deep,
  title={Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images},
  author={Zhu, Heming and Cao, Yu and Jin, Hang and Chen, Weikai and Du, Dong and Wang, Zhangye and Cui, Shuguang and Han, Xiaoguang},
  booktitle={Computer Vision -- ECCV 2020},
  year={2020},
  publisher={Springer International Publishing},
  pages={512--530},
  isbn={978-3-030-58452-8}
}

Learning Part Generation and Assembly for Sketching Man-Made Objects

Dong Du, Heming Zhu, Yinyu Nie, Yizhou Yu, Shuguang Cui, Ligang Liu, Xiaoguang Han#

Computer Graphics Forum (CGF), 2020

paper code bibtex

@article{du2020learning,
  title={Learning Part Generation and Assembly for Sketching Man-Made Objects},
  author={Du, Dong and Zhu, Heming and Nie, Yinyu and Yu, Yizhou and Cui, Shuguang and Liu, Ligang and Han, Xiaoguang},
  journal={Computer Graphics Forum},
  year={2020},
  doi={10.1111/cgf.14184}
}

HomeFinder Revisited: Finding Ideal Homes with Reachability-Centric Multi-Criteria Decision Making

Di Weng, Heming Zhu, Jie Bao, Yu Zheng, Yingcai Wu#

CHI, 2018

paper bibtex

@inproceedings{weng2018homefinder,
  title={HomeFinder Revisited: Finding Ideal Homes with Reachability-Centric Multi-Criteria Decision Making},
  author={Weng, Di and Zhu, Heming and Bao, Jie and Zheng, Yu and Wu, Yingcai},
  booktitle={Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
  pages={1--12},
  year={2018},
  doi={10.1145/3173574.3173821}
}

• Apr 2025 – Aug 2025Advanced Topics of Computer Vision and Computer Graphics in the Age of Artificial Intelligence
  Saarland University
  A computer graphics and vision course for graduate students majoring in computer science.
• Sep 2017 – Jan 2018Computer Graphics
  Zhejiang University
  A computer graphics course for senior undergraduate students majoring in computer science.

Conference Reviewer

• ACM SIGGRAPH
• ACM SIGGRAPH Asia
• IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
• International Conference on Computer Vision (ICCV)
• European Conference on Computer Vision (ECCV)
• International Conference on 3D Vision (3DV)

Journal Reviewer

• Nature Communications
• IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
• IEEE Transactions on Visualization and Computer Graphics (TVCG)
• IEEE Transactions on Image Processing (TIP)
• IEEE Transactions on Multimedia (TMM)
• IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
• Frontiers of Computer Science