Ultraleap, Prophesee and TCL RayNeo partner to develop innovative technology for AR glasses

Ultraleap has announced a strategic partnership with Prophesee SA, inventor of the world’s most advanced neuromorphic vision systems, and TCL RayNeo to develop low power tracking technology that can be used in AR glassespushing the boundaries of augmented reality (AR) experiences. This collaboration brings together Ultraleap’s advanced hand tracking technology, Prophesee’s event-based vision sensing technology and TCL RayNeo’s AR expertise in comprehensive AR hardware and software development, to create AR glasses that offer leading-edge interactivity and immersion.

Leveraging Ultraleap’s cutting-edge computer vision and machine learning models along with Prophesee’s breakthrough event-based Metavision® sensors and TCL RayNeo’s state-of-the-art glasses technology that feature unparalleled image quality and AI+AR features in an ergonomic form factor, the work from this collaboration aims at addressing key challenges in the AR industry such as size, power and usability. Future AR glasses need to deliver a seamless and natural user experience, enabling precise hand tracking in high-quality products that address users concerns.

Ultraleap’s technology together with Prophesee’s event-based Metavision offers unrivalled low power consumption and speed, ensuring accurate tracking and natural interactions that replace buttons and capacitors. Instead of constantly touching the glasses to interact, drawing attention to the user, hand tracking provides a natural interaction with swipes and double taps in a similar way to what phones and smartwatches have already established. TCL RayNeo’s revolutionary tech features crystal-clear image quality, real-time multi language dialog translation, navigation and AI-powered smart-assistant features. The merge of these technologies and interactions allows the creation of outstanding AR product experiences.

Tom Carter, CEO and co-founder at Ultraleap, said:

“We’re excited to work with TCL RayNeo and Prophesee to bring a new level of interactivity to AR glasses. Our goal is to make AR glasses that are as intuitive and immersive as possible. By combining our hand tracking technology with TCL RayNeo’s AR expertise and Prophesee’s event sensors, we will be creating products that not only enhance user experience but also set a new standard for the industry.”

Howie Li, Founder and CEO at RayNeo, commented:

“This partnership with Ultraleap and Prophesee is an exciting step forward in the AR space. Ultraleap’s hand tracking technology complements our glasses design, enabling us to develop AR glasses that are not only functional but also transformative. We believe this collaboration will drive the future of AR, offering users an unparalleled blend of the virtual and physical worlds.”

Luca Verre, CEO and co-founder at Prophesee, said:

“Our established relationship with Ultraleap in integrating Prophesee’s GenX320 event-based vision sensors with Ultraleap’s advanced computer vision and machine learning tracking models has demonstrated benefits for more intuitive, immersive and user-friendly XR devices. By combining this with TCL RayNeo’s expertise, we can together unlock significant performance and usability improvements to the current state of AR systems which will expand the market potential and capabilities of these applications.”