Parts by BoundariesNative Part-Aware 3D Generation with Seg-Voxel Representation

Junlin Hao* Jiatong Xia* Xibin Song Senbo Wang Zongming Guo Pan Ji Xinggong Zhang
*Equal contribution
In Submission
Generated 3D objects shown as whole shapes with predicted part boundaries (left) and as decomposed, colour-coded parts (right)
Our method natively integrates part decomposition into the 3D generation pipeline, jointly producing high-fidelity geometry and part-separation cues that explicitly encode the object's decomposable structure and ultimately yield coherent part assets.

Abstract

Recent 3D generative models produce high-quality assets but typically treat objects as monolithic shapes. Existing part-aware approaches address this limitation through external segmentation, predefined layouts, or additional planning, leaving shape generation and part discovery largely decoupled. In this work, we propose a native part-aware 3D generation framework that models inter-part separation instead of explicit part assignments. Our key observation is that recovering part structure does not require explicit part assignments over the entire shape; it is sufficient to identify the interfaces where contacting parts should be separated. We therefore cast part decomposition as a local boundary prediction task, replacing open-ended part assignments with simple binary separation cues. To support this formulation, we introduce Seg-Voxel, a sparse voxel representation built upon the voxel design of TRELLIS.2 that jointly encodes geometry and inter-part boundaries. We further develop a native 3D generative pipeline that synthesizes Seg-Voxel to jointly generate object geometry and the separation structure required to partition it into individual components. The predicted boundaries are refined to ensure reliable geometric separation, then reassigned to adjacent components to recover coherent part assets. Experiments demonstrate that our method outperforms existing part-aware approaches in geometric quality, decomposition accuracy, and efficiency, enabling high-quality native part-aware generation without external segmentation or complex post-generation planning.

Method

Seg-Voxel representation

Diagram of converting a part-labelled mesh to Seg-Voxel and back
Seg-Voxel and the instant bidirectional conversion between a part-structured 3D asset and Seg-Voxel. A voxel is marked as a segment boundary when its surface intersections carry more than one part label; removing boundary faces disconnects adjacent parts.

Overall framework

Overall pipeline: Seg-Voxel VAE, flow-based latent generation, boundary decoding and boundary-based part recovering
Part meshes are converted into Seg-Voxels and encoded by a Seg-Voxel VAE. A flow-based generator synthesizes Seg-Voxel latents conditioned on the input image, which are decoded into geometry together with initial separation boundaries. The boundaries are then completed, used to split the geometry into disconnected components, and reassigned to neighbouring components to recover the final parts.

Boundary-based part recovering

Six steps of boundary completion and assignment
(1) Identify incomplete boundaries and (2) build cross-boundary pairs; (3) compute the path-traffic of each face as the number of shortest residual paths passing through it; (4) starting from the highest-traffic face, expand the search radius to find open boundary ends and connect them; (5) removing the completed boundary yields separate components, whose labels then (6) propagate synchronously to assign the boundary surface.

Results

Part-level 3D generation

Qualitative comparison with PartPacker, PartCrafter, OmniPart, XPart and SegviGen
Qualitative comparison of image-conditioned part-level 3D generation.
MethodCD ↓F10.1 ↑mCD ↓mF10.1 ↑Time (s) ↓
PartPacker0.50694.745.86971.1423.76
PartCrafter0.80290.217.77263.52104.99
OmniPart0.43295.741.59985.4638.61
XPart0.40795.744.44169.17442.89
SegviGen0.20398.131.79688.35157.75
Seg-Voxel (Ours)0.20398.141.24291.0320.68

Evaluated on 300 held-out objects from HY3D-Bench Part. CD / F1 measure the merged whole object; mCD / mF1 measure individual parts with best-match evaluation.

Seg-Voxel VAE reconstruction

VAE reconstruction results across increasing part complexity
Reconstruction results of our Seg-Voxel VAE across increasing levels of part complexity.
MethodCD ↓F10.01 ↑F10.005 ↑mCD ↓mF10.01 ↑mF10.005 ↑
TRELLIS.2 – 5120.005695.1465.68–––
TRELLIS.2 – 10240.005595.1765.84–––
Seg-Voxel – 512 (Ours)0.005695.1465.730.47384.2475.35
Seg-Voxel – 1024 (Ours)0.005595.1765.870.45686.7379.12

All values ×102. Trained only at resolution 512, Seg-Voxel generalizes directly to 1024 at inference.

Ablation of boundary post-processing

Ablation comparison of boundary completion strategies
Path-traffic-guided completion closes larger gaps that remain open after fixed-iteration dilation, separating parts that would otherwise stay connected.
CompletionmCD ↓mF10.1 ↑
No completion1.97387.62
Dilation1.32890.55
Ours1.24291.03
AssignmentmCD ↓mF10.1 ↑
N-Copy2.28185.27
N-Max1.31189.78
Ours1.24291.03

More results

Additional generated objects and their decomposed parts
Additional qualitative results. Our method generates coherent parts that assemble into high-fidelity complete objects.