Hemispherical Nanowire Array based Bionic Eye Devices with In-Sensor Neuromorphic Signal Processing

Vision plays a crucial role in artificial systems such as surveillance, manufacturing, and robotics. However, the capabilities of conventional cameras are constrained by their design. Planar image sensors often result in significant aberration issues. While complex multi-lens systems can mitigate aberrations, they also increase the size and weight of the camera and limit its field of view. Additionally, the separation of imaging, memory, and signal processing units can lead to excessive signal transmission, delays, and high energy consumption—all of which are detrimental to the rapid advancement of artificial intelligence applications.<br/>Drawing inspiration from the natural vision of animals, we have developed bionic eye devices featuring a curved artificial retina equipped with onboard signal processing capabilities. These devices use high-density curved nanowire arrays that emulate a retinal neuron array, endowing the bionic eye with a compact design, superior imaging performance, and an ultra-wide field of view exceeding 120 degrees. We have embedded advanced neuromorphic signal processing functions at the pixel level, including capabilities for color distinction, contrast enhancement, noise reduction, and motion detection. Additionally, we have incorporated electrically switched working modes and adaptive optics to enhance the adaptability of our bionic eyes in a variety of application settings.