Apple VR headset could turn your fingers into holographic controllers

VR headset
(Image credit: Mark Nazh / Shutterstock)

Apple has been granted a patent relating to the 3D modeling of fingers for in-air gesture recognition – suggesting this could be a feature of the upcoming Apple VR headset.

The patent, published by the US Patent & Trademark Office, details a system capable of generating a 3D model of fingers to be used to navigate virtual environments.

It’s worth noting that this technology relates to Apple’s rumored VR headset project, rather than its in-development Apple Glasses, and therefore substantiates claims made by various sources that the headset could arrive as early as 2022.

The patent refers to both finger gestures and visual touch detection, with figure images outlining how the system might work.  

Apple VR patent

(Image credit: US Trademark and Patent Office)

In the above image, for example, a diagram illustrates a potential system setup for generating a 3D model of a fingertip using a combination of cameras and depth sensors. Accompanying text also references contour alignment-based algorithms that could be used to enable hand tracking.

While this approach to finger tracking may be new, the actual result sounds similar to the tracking software we’ve seen in existing VR headsets, like the Oculus Quest 2.

Of course, these Apple-patented systems are likely in the early stages of development, but they nonetheless offer an exciting glimpse at what to expect from the company’s inaugural VR headset – whenever it arrives. 

What else do we know?

As for further details on Apple’s flagship VR project, it’s a mixture of conjecture and well-advised rumors at this point.

We’ve heard mutterings regarding possible dual 8K displays, eye-tracking software and LiDAR scanning sensors on the headset, as well as wearable haptic controllers that might serve to complement the 3D modeling software detailed above.

In addition to features, though, we’ve also heard some less-than-exciting rumors regarding the price of Apple’s VR headset. While an official figure has, of course, not yet been confirmed, a report by The Information has the device priced at an eye-watering $3,000. 

That’s a number that’s been corroborated by Bloomberg sources, who claim Apple is expecting the VR headset to sell roughly one unit per store per day. 

So, the bottom line: Apple’s VR headset is almost certainly on its way – you just might need to start saving now to get your hands on one.

Stay tuned to TechRadar for our coverage of WWDC 2021 (Apple’s annual Worldwide Developers Conference) in June, where we might get some more official information regarding the company’s coveted VR project.

Via Patently Apple 

Axel Metz
Senior Staff Writer

Axel is a London-based Senior Staff Writer at TechRadar, reporting on everything from the latest Apple developments to newest movies as part of the site's daily news output. Having previously written for publications including Esquire and FourFourTwo, Axel is well-versed in the applications of technology beyond the desktop, and his coverage extends from general reporting and analysis to in-depth interviews and opinion. 


Axel studied for a degree in English Literature at the University of Warwick before joining TechRadar in 2020, where he then earned an NCTJ qualification as part of the company’s inaugural digital training scheme.