Abstract:Recently released open-source pre-trained foundational image segmentation and object detection models (SAM2+GroundingDINO) allow for geometrically consistent segmentation of objects of interest in multi-view 2D images. Users can use text-based or click-based prompts to segment objects of interest without requiring labeled training datasets. Gaussian Splatting allows for the learning of the 3D representation of a scene's geometry and radiance based on 2D images. Combining Google Earth Studio, SAM2+GroundingDINO, 2D Gaussian Splatting, and our improvements in mask refinement based on morphological operations and contour simplification, we created a pipeline to extract the 3D mesh of any building based on its name, address, or geographic coordinates.
Submission history
From: Kyle Gao [view email]
[v1]
Tue, 31 Dec 2024 19:53:27 UTC (11,830 KB)
[v2]
Tue, 7 Jan 2025 16:49:29 UTC (11,830 KB)
[v3]
Thu, 5 Jun 2025 23:59:49 UTC (5,794 KB)