Publications

Home /
Publications

CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splatting

Abstract We present CLIPGaussian, a framework that performs universal, multimodal style transfer by operating directly on Gaussian primitives—the shared representation underlying modern 2D, 3D, and 4D Gaussian Splatting pipelines. Instead of relying on heavy generative models, CLIPGaussian uses CLIP-driven text and image cues to steer both the appearance and, when beneficial, the geometry of Gaussian elements. This makes stylization a geometric-aware process: colors shift in locally meaningful ways, textures reorganize to match the target style, and structural details adapt subtly without disrupting the underlying scene. Because the method works natively on Gaussian fields, the same mechanism seamlessly applies to single images, complex 3D objects, temporally coherent videos, and dynamic 4D reconstructions.

PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopy

Abstract Endoluminal endoscopic imaging—used in diagnosing colorectal cancer and other internal diseases—stands to benefit greatly from accurate 3D reconstructions and novel-view synthesis. However, current methods struggle with artifacts due to constrained camera trajectories and lighting effects that depend heavily on view, often overfitting and failing when viewing from novel angles.

MiraGe: Editable 2.5D Image Representations with Flat-Controlled 3D Gaussians

Abstract Implicit Neural Representations (INRs) encode images as continuous functions that map pixel coordinates to RGB values, achieving compact storage and high visual fidelity. Recent work such as GaussianImage replaces neural MLPs with collections of 2D Gaussian primitives, reaching similar reconstruction quality and compression but offering limited editability. In practice, creators often need to adjust content—move objects, bend a photo, cast new shadows, or create parallax—all of which are awkward within purely 2D or purely additive Gaussian schemes.

VeGaS: Video Gaussian Splatting

Abstract Modern video representations often prioritize reconstruction quality and compression, but they can be difficult to edit in a precise and controllable way. VeGaS (Video Gaussian Splatting) tackles this gap by adapting Gaussian Splatting ideas to 2D videos while explicitly modeling nonlinear motion and appearance changes across time.

NegGS: Negative Gaussian Splatting

Abstract One of the key strengths of 3D rendering lies in its ability to simulate intricate scenes with high fidelity. Among the recent advancements, Gaussian Splatting has gained prominence for its fast training and inference capabilities.