Hand Tracking

Hand tracking is implemented in the STD.DEV Extended Reality Engine and uses the precise position data from the operating system's native XR platform. With this technique, the movement and position of the user's individual fingers are tracked in real time as soon as the hand is detected in the system's field of view.

The conversion of this data in the engine creates the basis for various interaction possibilities. In addition to specific gesture recognition, which functions as a command input, the creation of a cursor is also made possible. This cursor, controlled by hand and finger movements, allows the user to select, manipulate, or trigger other interactions in procedurally generated scenes.