Generalized Scene Reconstruction Definition: GSR is a method for automated virtualization of scenes wherein a scene model representing a generalized light field and a relightable matter field is created.
Ten Reasons Why it’s Hard to Make GSR Easy
GSR requires more than incremental changes to existing approaches. It’s challenging for ten reasons. Quidient has reimagined a solution from top-to-bottom with these reasons in mind.
All Lighting Environments
Three Key Technologies
Quidient meets the challenges of GSR using three key technologies:
plenoptic fields, 5D databases, and AI / Machine Learning.
Plenoptic Fields
Most 3D reconstruction approaches today locate features and surfaces in space, but don’t represent light. By contrast, Quidient reconstructs the flow of light throughout a scene (a generalized light field). Simultaneously, Quidient creates a relightable matter field, which includes information about how materials at each location emit, absorb, reflect, scatter, or transmit light. Therefore, objects can be placed in any new lighting environment, and their reflections and refractions will update correctly. The generalized light field can also be reused to light new scenes.
A Word from John Leffingwell
AI / Machine Learning
Traditional “Black Box” AI/ML using conventional images requires massive training data sets and has not yielded adequate accuracy for the kinds of transformational applications that Quidient will enable. Quidient engines make extensive use of AI, including a novel ML approach called Physics-based Machine Learning. Within the engine, AI makes scene reconstruction more efficient. Within engine-based apps, it creates a powerfully accurate source of data for higher level AI tasks by feeding a 5D model into network for training (rather than a conventional image).
5D Databases
Quidient’s voxel-based 5D Database represents a major shift in underlying architecture. It provides a novel means for separately encoding a matter field (as 3D Voxels, shown in turquoise) simultaneously with a light field (as 2D solid-angle elements, or “Saels”, shown in yellow). Both are stored in octrees. This spatially sorted, hierarchical approach leads to randomly accessible and searchable scenes with exceptionally fast subscene insertion and extraction. Its speed meets critical requirements for representing scenes with virtually unlimited levels of detail, such as an interactive city map.
A Word from Don Meagher
