Pratheba Selvaraju¹ Mohamed Nabail¹ Marios Loizou² Maria Maslioukova²
Melinos Averkiou² Andreas Andreou² Siddhartha Chaudhuri³ Evangelos Kalogerakis¹

¹UMass Amherst ²University of Cyprus / CYENS CoE ³Adobe Research / IIT Bombay

Abstract

We introduce BuildingNet: (a) a large-scale dataset of 3D building models whose exteriors are consistently labeled, and (b) a graph neural network that labels building meshes by analyzing spatial and structural relations of their geometric primitives. To create our dataset, we used crowdsourcing combined with expert guidance, resulting in 513K annotated mesh primitives, grouped into 292K semantic part components across 2K building models. The dataset covers several building categories, such as houses, churches, skyscrapers, town halls, libraries, and castles. We include a benchmark for evaluating mesh and point cloud labeling. Buildings have more challenging structural complexity compared to objects in existing benchmarks (e.g., ShapeNet, PartNet), thus, we hope that our dataset can nurture the development of algorithms that are able to cope with such large-scale geometric data for both vision and graphics tasks e.g., 3D semantic segmentation, part-based generative models, correspondences, texturing, and analysis of point cloud data acquired from real-world buildings. Finally, we show that our mesh-based graph neural network significantly improves performance over several baselines for labeling 3D meshes.

Paper

BuildingNet.pdf, 17.3MB

Citation

Pratheba Selvaraju, Mohamed Nabail, Marios Loizou, Maria Maslioukova, Melinos Averkiou, Andreas Andreou, Siddhartha Chaudhuri, Evangelos Kalogerakis, "BuildingNet: Learning to Label 3D Buildings", Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021

Bibtex

@inproceedings{Selvaraju:2021:BuildingNet, 
  author = {Pratheba Selvaraju and Mohamed Nabail and Marios Loizou and Maria Maslioukova and
            Melinos Averkiou and Andreas Andreou and Siddhartha Chaudhuri and Evangelos Kalogerakis},
  title = {BuildingNet: Learning to Label 3D Buildings},   
  booktitle = {IEEE/CVF International Conference on Computer Vision (ICCV)},
  year = {2021}   
}   

Additional supplementary material: a few video examples of UI operations used for labeling - video_UI_tutorial_parts.zip.

Presentation at ICCV

Slides in PDF format, 7.4MB.

YouTube video of the presentation:

Poster

BuildingNet_poster.pdf, 2.9MB.

BuildingNet Challenge

The BuildingNet Challenge was held in conjunction with the Second Workshop on Structural and Compositional Learning on 3D Data @ CVPR 2023 Vancouver (Canada).The challenge focused on the task of part segmentation of 3D buildings. For the purposes of this challenge the newly released BuildingNet v1 dataset was used. For more information please visit the challenge website on EvalAI.

Challenge presentation

Slides in PDF format, 6.4MB.

YouTube video of the challenge presentation at the 2nd StruCo3D (CVRPW):

Dataset and Code

The official implementation can be found in our github repository. Please fill in this form, in order to get access to the official release of the BuildingNet dataset.