INLAY3D: PRECISE PART-LEVEL TEXTURE AND SHAPE MANIPULATION OF 3D ASSETS
Abstract
real-world 3D asset production pipelines, artists need to edit and refine the details of the local regions, yet this problem remains insufficiently explored. Such local edits should provide the following capabilities: 1) Part-level spatial control: identifying the complete 3D target part intended by the user while preserving non-target regions and boundaries; and 2) Attribute-specific editing: supporting texture editing, shape manipulation, or joint shape-and-texture manipulation within the target part. However, existing methods often define the editing region imprecisely, either with coarse 3D boxes or by implicit region selection. They lack an editing framework that enables decoupled texture and geometry editing. To address these issues, we propose Inlay3D, a novel framework for precise part localization and decoupled texture and shape editing. Specifically, Inlay3D first performs Target Part Extraction, selecting an explicit 3D target part from 3D part candidates guided by a lightweight 2D mask. It then applies Two-Stage Editing to the selected part. In Isolated Mesh Editing, we edit a part-isolated representation that contains only the selected region. As a result, the edit can focus on the target part itself, leading to high-quality results while reducing contextual coupling from non-edited regions. We further introduce Boundary Refinement, which refines a narrow boundary region to remove boundary artifacts while preserving the non-target region. Extensive experiments demonstrate that Inlay3D achieves state-of-the-art results in editing quality and non-target region preservation.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.