11
2025
-
04
Nanjing University's Wang Shuming team Optica: High-definition passive stereo meta-lens imaging
Author:
Introduction
Accurately obtaining detailed three-dimensional information of objects has been a key challenge in scientific research and technological applications. When attempting to capture three-dimensional objects in two-dimensional images, a significant amount of three-dimensional detail is inevitably lost. While traditional Time-of-Flight (ToF) and structured light illumination techniques can reconstruct three-dimensional shapes to some extent, they require active illumination and are extremely sensitive to environmental conditions. In contrast, polarimetric stereo imaging can passively collect reflected light, avoiding the complex calculations of binocular disparity systems. However, traditional methods rely on multiple polarizers or multiple exposures to separate four linear polarizations, which limits real-time single-shot imaging.
Recently, the Shuming Wang team from Nanjing University proposed and demonstrated a miniaturized snapshot polarimetric stereoscopic imaging technology ( SPSIM ). This technology utilizes a polarization metasurface lens to decouple and focus full-Stokes polarized light. With the help of a neural network algorithm, it achieves high-resolution, real-time three-dimensional shape reconstruction. The polarization metasurface lens has an average extinction ratio of up to 25 dB (comparable to commercial polarizers), and a center wavelength efficiency of 65% (exceeding the 50% limit of commercial polarization cameras), making it possible to acquire full-Stokes parameters (FSPs). Assisted by the neural network algorithm, the system can generate a complete three-dimensional texture of the target object in just a few seconds. Notably, compared to traditional three-dimensional reconstruction systems that only use linear polarization, SPSIM significantly improves the accuracy of surface normal recovery by introducing orthogonal circular polarization, achieving depth accuracy within 0.15 mm. The relevant results are published in “ Miniaturized high-efficiency snapshot polarimetric stereoscopic imaging ” in Optica 。
Figure 1: Schematic diagram of miniaturized snapshot polarimetric stereoscopic imaging (Source: Optica )
The 3D reconstruction work of the SPSIM system starts with preprocessing to obtain unique values for zenith angle ϑ and azimuth angle ψ. Depth information is roughly recovered using the measured full-Stokes parameters (FSP), angle of polarization (AOP), and degree of polarization (DOP). To address the ambiguity of the azimuth angle ψ, we employed Shape from Shading (SFS) as a physical prior. A neural network was then introduced, training an enhanced U-Net network using the full-Stokes parameters (FSP) and prior information to achieve accurate surface normal recovery.
Figure 2: Flowchart of the polarization 3D reconstruction system (Source: Optica )
To evaluate network performance, researchers conducted qualitative and quantitative analyses of the reconstructed surface normal maps in the test set. Tests on objects such as bottles and cups revealed that under natural lighting, human eyes and standard cameras find it difficult to distinguish the details of resin materials, while the SFP method exhibits high sensitivity. Compared to traditional methods, the neural network-driven SFP significantly reduces reconstruction errors on smooth surfaces, with a significant improvement in accuracy. Simultaneously, tests confirmed that circular polarization (CP) is crucial for shape recovery; the information it provides can accurately capture subtle contour changes. The lack of CP results in large errors and a lack of detail in the normal map, indicating that incorporating CP in polarimetric stereo imaging is key to obtaining detailed object textures.
Figure 3: Surface normals of three-dimensional objects and accuracy improvement introduced by circular polarization (Source: Optica )
Using discrete integral surface normals effectively avoids the integrability problem. Experiments on different objects show that this method achieves excellent reconstruction results. It can not only accurately distinguish the depth of different parts of an object, such as clearly distinguishing the depth difference between a dog's legs and the background, but also excellently preserves the surface details of the object, vividly restoring the animal's facial expressions. When reconstructing the Moai statue, even a slight protrusion of only 0.15 mm on the mouth can be accurately recovered, with a reconstruction depth accuracy of less than 0.15 mm. The experiment also captures the object from multiple angles, and by fusing point cloud data, successfully recovers the complete 3D texture.
Figure 4: Three-dimensional depth results and all-angle depth recovery (Source: Optica )
Summary
Compared to traditional methods, the SPSIM system features ultra-compactness, high efficiency, and high resolution, enabling it to be easily integrated into portable devices and operate stably in extreme environments, injecting new vitality into the development of next-generation imaging systems. This research undoubtedly opens up new directions for the three-dimensional imaging field and is expected to be widely applied in various fields, promoting further innovation in related technologies.
Paper Information
Boyan Fu, Xuxi Zhou, Tianyue Li, Hao Zhu, Zhen Liu, Shiyu Zheng, Yifan Zhou, Yiwan Yu, Xun Cao, Shuming Wang, Zhenlin Wang, and Shining Zhu, "Miniaturized high-efficiency snapshot polarimetric stereoscopic imaging," Optica 12, 391-398 (2025)
LATEST NEWS
2025-06-06
Photonic avalanche nanocrystals with >500-order optical nonlinear response
At the forefront of nonlinear optical materials research, photon avalanche (PA), a unique luminescence mechanism occurring in lanthanide-ion-doped systems, exhibits exponential response under continuous laser pumping through an energy positive feedback loop mechanism, thus demonstrating ultra-high-order nonlinear optical behavior far exceeding traditional upconversion processes.
2025-06-05
Ji Xingchen/Su Yikai LPR | 780 nm on-chip integrated high-Q ultra-wideband Fabry-Perot cavity
With the rapid development of applications such as quantum precision measurement, atom manipulation, and narrow linewidth lasers, higher and higher demands are placed on high-performance photonic devices operating in the visible and near-visible wavelength range (especially the 780 nm wavelength corresponding to the rubidium atomic transition).
2025-06-23
Binary optics and metasurface lenses
Bichromatic optics is a subject or an optical technology; the concept of a meta-lens is more inclined to be a device.
2025-06-23
Achromatic diffractive waveguide in AR glasses
AR glasses seem to have developed rapidly in recent years; many believe this is the device most likely to replace mobile phones in the future.