Akshay Krishnan
Description: LANe : Lighting Aware Neural Fields for Compositional Scene Synthesis
lane (201) nerf (185) automated driving (14)
We present Lighting-Aware Neural Fields (LANe) for compositional scene synthesis . With the disentanglement of the learnt world model and a class specific object model, our approach is capable of arbitrarily composing objects into the scene. Our novel light field modulated representation allows the object model to be rendered in scenes in a lighting-aware manner.
The figure above shows the same world model learnt and reused as background scenes on each row, and object models composed into scene in arbitrary poses and locations under different lighting conditions. Note that the newly synthesized objects are shaded appropriately based on the scene lighting condition in which it is placed, which indicates our approach LANe can compose multiple object models and world model with physical realistic and consistent results.
Neural fields have recently enjoyed great success in representing and rendering 3D scenes. However, most state-of-the-art implicit representations model static or dynamic scenes as a whole, with minor variations. Existing work on learning disentangled world and object fields do not consider the problem of composing objects into different world fields in a lighting-aware manner.
Akshay Krishnan