HeadsUp: Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures

2 min read Original article ↗

2026

Apple

Evangelos Ntavelis Sean Wu Mohamad Shahbazi Fabio Maninchedda Dmitry Kostiaev Artem Sevastopolsky Vittorio Megaro Trevor Phillips Alejandro Blumentals Shridhar Ravikumar Mehak Gupta Reinhard Knothe Jeronimo Bayer Matthias Vestner Simon Schaefer Thomas Etterlin Christian Zimmermann Mathias Deschler Peter Kaufmann Stefan Brugger Sebastian Martin Brian Amberg Tom Runia

*Work done during internship at Apple

Paper

We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a compact latent representation. This latent representation is then decoded into a set of UV-parameterized 3D Gaussians anchored to a neutral head template. This UV representation decouples the number of 3D Gaussians from the number and resolution of input images, enabling training with many high-resolution input views. We train and evaluate our model on an internal dataset with more than 10,000 subjects, which is an order of magnitude larger than existing multi-view human head datasets. HeadsUp achieves state-of-the-art reconstruction quality and generalizes to novel identities without test-time optimization. We extensively analyze the scaling behavior of our model across identities, views, and model capacity, revealing practical insights for quality-compute trade-offs. Finally, we highlight the strength of our latent space by showcasing two downstream applications: generating novel 3D identities and animating the 3D heads with expression blendshapes.

@article{ntavelis2026headsup,
  title={Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures},
  author={Ntavelis, Evan and Wu, Sean and Shahbazi, Mohamad and Maninchedda, Fabio and Kostiaev, Dmitry and Sevastopolsky, Artem and Megaro, Vittorio and Phillips, Trevor and Blumentals, Alejandro and Ravikumar, Shridhar and Gupta, Mehak and Knothe, Reinhard and Bayer, Jeronimo and Vestner, Matthias and Schaefer, Simon and Etterlin, Thomas and Zimmermann, Christian and Deschler, Mathias and Kaufmann, Peter and Brugger, Stefan and Martin, Sebastian and Amberg, Brian and Runia, Tom},
  journal={arXiv preprint arXiv:2605.04035},
  year={2026}
}