news

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

July 31 news, XREAL seriesARThe latest member of glasses, XREAL Air 2 UltraIt is currently on sale in China, with a starting price of 3,999 yuan on JD.com. According to reports, this AR glasses is mainly aimed at developers, aiming to lower the threshold for developers to enter spatial computing and establish a more prosperous AR ecosystem.

As XREAL's second 6 DoF (Six Degrees of Freedom) full-function glasses, XREAL Air 2 Ultra uses dual environment perception sensors (SLAM Camera) to achieve lightweight spatial computing. It supports high-precision and low-latency 6DoF spatial positioning and gesture interaction by carrying dual environment perception sensor hardware + software SDK.

Specifically, the technology uses dual environmental perception sensors located on both sides of the XREAL Air 2 Ultra to identify feature points and monitor the movement of feature points displayed in the camera image over time. Combining the movement of these points with the glasses' IMU sensor data, the NRSDK can accurately track the position and orientation of the glasses during spatial navigation. The 6DoF tracking function not only builds maps in real time, but also integrates spatialAnchor Point, providing developers with detailed information about the physical structure in the environment, thereby enhancing application functionality.

In addition to 6DoF motion tracking, XREAL's latest software NRSDK, built on the cross-platform game engine Unity, further enhances the hand tracking and gesture recognition functions for developers to develop applications. Among them, the "hand tracking" function of NRSDK not only stably tracks the position of key hand points, but also seamlessly performs real-time recognition of gestures. The recognized hand gestures will be presented intuitively from a first-person perspective, making it easier for developers to interact with virtual objects in the real world intuitively, naturally, and immersively.

In addition, through the fusion of computer vision and advanced algorithms, NRSDK's plane detection function can accurately identify horizontal and vertical planes in real time, accurately capture and track environmental features, and draw accurate and dynamic three-dimensional space maps for developers. Deep mesh is also a core function provided by NRSDK, which can generate triangular mesh surfaces with semantic labels in real time. When processing virtual content, this mesh plays a key role in real-time occlusion rendering and collision detection, allowing virtual content to be better integrated with the real environment.

According to reports, with the help of image tracking, NRSDK can also identify and track specific images, allowing digital objects to have spatial connections with objects in the real world, greatly expanding the possibilities of AR applications. For example, NRSDK can detect a painting on a wall or a book on a table, and can also track moving images, such as rotating billboards or posters held by pedestrians. This image tracking function can help developers realize the display of virtual content based on image objects in natural environments, bringing practical AR solutions to multiple fields such as advertising, education, and entertainment.

Spatial anchors are also an important AR function. NRSDK provides spatial anchor functions for XREAL glasses and introduces a shared anchor mechanism, allowing different users to interact with the same virtual objects anchored in the real world, opening up new possibilities for multi-person collaboration scenarios.

It is worth mentioning that in terms of display, the Air 2 Ultra has increased the FoV (field of view) to 52°, which increases the equivalent 4-meter projection screen from 130 inches of Air 2 to 154 inches. Combined with the optimization of edge clarity, it can make the field of view wider and the immersion stronger.

When used with Beam Pro, Air 2 Ultra can also achieve a 6DoF hovering space viewing experience. It is reported that Air 2 Ultra will also launch productized gesture functions for users in the future as a system-level interaction method. The combination of Ultra + Beam Pro can be regarded as an exclusive integrated development kit created by XREAL for the future of AR. (Dingxi)

This article is from NetEase Technology Report. For more information and in-depth content, follow us.