TIP-Editor

TIP-Editor is an accurate 3D editor that supports text and image hints, allowing users to precisely control the appearance and position of the editing area through text and image hints and 3D bounding boxes. Employs a stepwise 2D personalization strategy to better learn representations of existing scenes and reference images, enabling precise appearance control through local editing. TIPEditor utilizes an unambiguous and flexible 3D Gaussian splash as a 3D representation for local editing while keeping the background intact. Extensive experiments have proven that TIP-Editor accurately edits according to text and image prompts within the specified bounding box area, and the editing quality and alignment with the prompts are both qualitatively and quantitatively better than the baseline.

Demand group:

"Suitable for scenes that require accurate control of the appearance and position of 3D editing, such as virtual scene design, game development, etc."

Example of usage scenario:

Virtual scene design: Use TIP-Editor for precise editing and design of virtual scenes.

Game development: Developers can use TIP-Editor to precisely control the appearance of 3D scenes in games.

Art creation: Artists can use TIP-Editor to achieve precise editing of the 3D appearance of artworks.

Product features:

Accept text and image tips

Supports 3D bounding boxes to specify editing areas

Learning representations of existing scenes and reference images using 2D personalization strategies

Using 3D Gaussian Splash as 3D representation for local editing