PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction
PixARMesh is a mesh-native autoregressive framework for single-view 3D scene reconstruction. Instead of reconstructing via intermediate volumetric or implicit representations, PixARMesh directly models instances with native mesh representation. Object poses and meshes are predicted in a unified autoregressive sequence.
Model Details
Reconstructing complete 3D indoor scenes from a single RGB image is a complex task. PixARMesh jointly predicts object layout and geometry within a unified model, producing coherent and artist-ready meshes in a single forward pass. By augmenting a point-cloud encoder with pixel-aligned image features and global scene context via cross-attention, the model enables accurate spatial reasoning. Scenes are generated autoregressively from a unified token stream containing context, pose, and mesh, yielding compact meshes with high-fidelity geometry.
- Repository: https://github.com/mlpc-ucsd/PixARMesh
- Paper: arXiv:2603.05888
- Project Page: https://mlpc-ucsd.github.io/PixARMesh/
Citation
If you find PixARMesh useful in your research, please consider citing:
@inproceedings{zhang2026pixarmesh,
author = {Zhang, Xiang and Yoo, Sohyun and Wu, Hongrui and Li, Chuan and Xie, Jianwen and Tu, Zhuowen},
title = {PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2026},
pages = {5881-5891}
}
Acknowledgements
PixARMesh builds upon several excellent open-source projects including Grounded-Segment-Anything, Depth Pro, DINOv2, and weights from EdgeRunner and BPT. We also use physically-based renderings from the 3D-FRONT scenes.