avatar

Heming Zhu 朱鹤鸣

Ph.D. Candidate @ D6, Max Planck Institute for Informatics

hezhu at mpi-inf.mpg.de

About

I am currently a final-year PhD student (since 2022) at the Max Planck Institute for Informatics in the Visual Computing and Artificial Intelligence department, supervised by Dr. Marc Habermann and Prof. Christian Theobalt.

I mainly work on ULTRA HIGH-fadelity human digitalization and synthesis, including:
  • Ultra-high quality animatable clothed human avatar reconstruction.
  • High-quality 3D shape reconstruction from single images.
  • Generative models for avatars and garments.
  • Effecient 4D shape representations.

I received my M.Sc. (2020) and B.Sc. (2017) in Computer Science and Technology from Zhejiang University. Before joining MPI, I was a research assistant at the GAP Lab at The Chinese University of Hong Kong, Shenzhen, supervised by Prof. Xiaoguang Han.

Preprints

*Joint First Author, #Corresponding Author

MUA: Mobile Ultra-detailed Animatable Avatars

Heming Zhu, Guoxing Sun, Marc Habermann#

arXiv, 2026

@misc{zhu2026mua,
  title={MUA: Mobile Ultra-detailed Animatable Avatars},
  author={Zhu, Heming and Sun, Guoxing and Habermann, Marc},
  year={2026},
  eprint={2604.18583},
  archivePrefix={arXiv},
  primaryClass={cs.CV},
  url={https://arxiv.org/abs/2604.18583},
}

UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment

Heming Zhu, Guoxing Sun, Christian Theobalt, Marc Habermann#

arXiv, 2025

@article{zhu2025uma,
  title={UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment},
  author={Zhu, Heming and Sun, Guoxing and Theobalt, Christian and Habermann, Marc},
  journal={arXiv preprint arXiv:2506.01802},
  year={2025}
}

Publications

*Joint First Author, #Corresponding Author

GIGA: Generalizable Sparse Image-driven Gaussian Avatars

Anton Zubekhin, Heming Zhu, Paulo Gotardo, Thabo Beeler, Marc Habermann, Christian Theobalt#

3DV, 2026

@article{zubekhin2025giga,
  title={GIGA: Generalizable Sparse Image-driven Gaussian Humans},
  author={Zubekhin, Anton and Zhu, Heming and Gotardo, Paulo and Beeler, Thabo and Habermann, Marc and Theobalt, Christian},
  year={2025},
  journal={arXiv},
  eprint={2504.07144},
}

EVA: Expressive Virtual Avatars from Multi-view Videos

Hendrik Junkawitsch, Guoxing Sun, Heming Zhu, Christian Theobalt, Marc Habermann#

Siggraph, 2025

@article{junkawitsch2025eva,
  title={EVA: Expressive Virtual Avatars from Multi-view Videos},
  author={Junkawitsch, Hendrik and Sun, Guoxing and Zhu, Heming and Theobalt, Christian and Habermann, Marc},
  booktitle={SIGGRAPH 2025 Conference Papers},
  pages={1--11},
  year={2025}
}

DUT: Real-time Free-view Human Rendering from Sparse-view RGB Videos using Double Unprojected Textures

Guoxing Sun, Rishabh Dabral, Heming Zhu, Pascal Fua, Christian Theobalt, Marc Habermann#

CVPR, 2025

@InProceedings{sun2025real,
  title={Real-time Free-view Human Rendering from Sparse-view RGB Videos using Double Unprojected Textures},
  author={Sun, Guoxing and Dabral, Rishabh and Zhu, Heming and Fua, Pascal and Theobalt, Christian and Habermann, Marc},
  year={2025},
  month={June},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
}

TEDRA: Text-based Editing of Dynamic and Photoreal Actors

Basavaraj Sunagad, Heming Zhu*, Mohit Mendiratta*, Adam Kortylewski, Christian Theobalt, Marc Habermann#

3DV, 2025

@misc{sunagad2024tedra,
  title={TEDRA: Text-based Editing of Dynamic and Photoreal Actors},
  author={Sunagad, Basavaraj and Zhu, Heming and Mendiratta, Mohit and Kortylewski, Adam and Theobalt, Christian and Habermann, Marc},
  year={2024},
  eprint={2408.15995},
  archivePrefix={arXiv},
  primaryClass={cs.CV},
  url={https://arxiv.org/abs/2408.15995},
}

TriHuman: A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis

Heming Zhu, Fangneng Zhan, Christian Theobalt, Marc Habermann#

ACM Transactions on Graphics (ToG), 2024 (presented at Siggraph Asia 2024)

@article{zhu2024trihuman,
  author={Zhu, Heming and Zhan, Fangneng and Theobalt, Christian and Habermann, Marc},
  title={TriHuman: A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis},
  year={2024},
  publisher={Association for Computing Machinery},
  address={New York, NY, USA},
  issn={0730-0301},
  url={https://doi.org/10.1145/3697140},
  doi={10.1145/3697140},
  journal={ACM Trans. Graph.},
  month=sep
}

ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering

Haokai Pang*, Heming Zhu*, Adam Kortylewski, Christian Theobalt, Marc Habermann#

CVPR, 2024

@InProceedings{Pang_2024_CVPR,
  author={Pang, Haokai and Zhu, Heming and Kortylewski, Adam and Theobalt, Christian and Habermann, Marc},
  title={ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  month={June},
  year={2024},
  pages={1165-1175}
}
SketchMetaFace

SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modeling

Zhongjin Luo, Dong Du, Heming Zhu, Hongbo Fu, Xiaoguang Han#

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023

@article{luo2023sketchmetaface,
  author={Luo, Zhongjin and Du, Dong and Zhu, Heming and Yu, Yizhou and Fu, Hongbo and Han, Xiaoguang},
  title={SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modeling},
  journal={IEEE Transactions on Visualization and Computer Graphics},
  year={2023}
}

Registering Explicit to Implicit: Towards High-Fidelity Garment Mesh Reconstruction from Single Images

Heming Zhu, Lingteng Qiu, Yuda Qiu, Xiaoguang Han#

CVPR, 2022

@InProceedings{Zhu_2022_CVPR,
  title={Registering Explicit to Implicit: Towards High-Fidelity Garment Mesh Reconstruction from Single Images},
  author={Zhu, Heming and Qiu, Lingteng and Qiu, Yuda and Han, Xiaoguang},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  month={June},
  year={2022},
  pages={3845-3854}
}
SimpModeling

SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design

Zhongjin Luo, Jie Zhou, Heming Zhu, Dong Du, Xiaoguang Han#, Hongbo Fu

User Interface Software and Technology (UIST), 2021

@inproceedings{luo2021simpmodeling,
  title={SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design},
  author={Luo, Zhongjin and Zhou, Jie and Zhu, Heming and Du, Dong and Han, Xiaoguang and Fu, Hongbo},
  booktitle={The 34th Annual ACM Symposium on User Interface Software and Technology},
  pages={854--863},
  year={2021}
}
Deep Fashion3D

Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images

Heming Zhu*, Yu Cao*, Hang Jin*, Weikai Chen, Dong Du, Zhangye Wang, Shuguang Cui, Xiaoguang Han#

ECCV, 2020 (oral, top 2%)

@inproceedings{zhu2020deep,
  title={Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images},
  author={Zhu, Heming and Cao, Yu and Jin, Hang and Chen, Weikai and Du, Dong and Wang, Zhangye and Cui, Shuguang and Han, Xiaoguang},
  booktitle={Computer Vision -- ECCV 2020},
  year={2020},
  publisher={Springer International Publishing},
  pages={512--530},
  isbn={978-3-030-58452-8}
}
PartSketcher

Learning Part Generation and Assembly for Sketching Man-Made Objects

Dong Du, Heming Zhu, Yinyu Nie, Yizhou Yu, Shuguang Cui, Ligang Liu, Xiaoguang Han#

Computer Graphics Forum (CGF), 2020

@article{du2020learning,
  title={Learning Part Generation and Assembly for Sketching Man-Made Objects},
  author={Du, Dong and Zhu, Heming and Nie, Yinyu and Yu, Yizhou and Cui, Shuguang and Liu, Ligang and Han, Xiaoguang},
  journal={Computer Graphics Forum},
  year={2020},
  doi={10.1111/cgf.14184}
}
HomeFinder

HomeFinder Revisited: Finding Ideal Homes with Reachability-Centric Multi-Criteria Decision Making

Di Weng, Heming Zhu, Jie Bao, Yu Zheng, Yingcai Wu#

CHI, 2018

@inproceedings{weng2018homefinder,
  title={HomeFinder Revisited: Finding Ideal Homes with Reachability-Centric Multi-Criteria Decision Making},
  author={Weng, Di and Zhu, Heming and Bao, Jie and Zheng, Yu and Wu, Yingcai},
  booktitle={Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
  pages={1--12},
  year={2018},
  doi={10.1145/3173574.3173821}
}

Projects

Teaching

Community Services

Conference Reviewer

  • ACM SIGGRAPH
  • ACM SIGGRAPH Asia
  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • International Conference on Computer Vision (ICCV)
  • European Conference on Computer Vision (ECCV)
  • International Conference on 3D Vision (3DV)

Journal Reviewer

  • Nature Communications
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  • IEEE Transactions on Visualization and Computer Graphics (TVCG)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Multimedia (TMM)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • Frontiers of Computer Science