Interactive Deformation of Light Fields
We present a software pipeline that enables an animator to deform light ﬁelds. The pipeline can be used to deform complex objects, such as furry toys, while maintaining photo-realistic quality. Our pipeline consists of three stages. First, we split the light ﬁeld into sub-light ﬁelds. To facilitate splitting of complex objects, we employ a novel technique based on projected light patterns. Second, we deform each sub-light ﬁeld. To do this, we provide the animator with controls similar to volumetric free-form deformation. Third, we recombine and render each sub-light ﬁeld. Our rendering technique properly handles visibility changes due to occlusion among sub-light ﬁelds. To ensure consistent illumination of objects after they have been deformed, our light ﬁelds are captured with the light source ﬁxed to the camera, rather than being ﬁxed to the object. We demonstrate our deformation pipeline using synthetic and photographically acquired light ﬁelds. Potential applications include animation, interior design, and interactive gaming.