IBR techniques that have the most potential for photorealism tend to be those that make use of densely sampled images. While using geometry helps reduce the database size, there is the problem of nonrigid effects such as reflection, transparency, and highlights. Without explicitly accounting for these effects, the Light Field sampling rate requirement would be even higher.
In this sketch, we propose a novel IBR representation to handle non-diffuse effects compactly, which we call locally reparameterized Light Field (LRLF). The LRLF is based on the use of local and separate diffuse and non-diffuse geometries. The diffuse geometry is associated with true depth while the non-diffuse geometry has virtual depth that provides local photoconsistency with respect to its neighbors.