This is the ultimate guide to Oculus Quest hand tracking. Serious, we’ve tried to cover absolutely everything you need to know about using your hands as your controllers on the Oculus Quest headset.
What hand tracking is and why it’s awesome.
Tricks for using hand tracking in games instead of your Oculus touch controllers.
The best Oculus Quest games which use hand tracking.
If we haven’t covered anything specific, comment down below and we’ll get you an answer. If you are a VR developer making a game that supports hand tracking, contact us and we’d love to feature it!
What is Oculus Quest Hand Tracking?
Hand tracking is a feature that allows you to use your hands instead of the Oculus touch controllers. With hand tracking, you can interact with objects more naturally using your fingers instead of with a controller in your hand.
Hand tracking is a feature usually reserved for more advanced and expensive VR headsets. It’s inclusion in the Oculus Quest is a big win for casual VR players looking to use advanced features.
As of Build 17.0 for the Quest, released on May 18, 2020, hand tracking is not an experimental feature anymore. It can be utilized by any VR game for the Oculus Quest.
How Does Hand Tracking Work?
Oculus Quest hand tracking uses the cameras on the outside of the Oculus Quest to track the position of your fingers and hand. Once calibrated, it uses sophisticated internal software to track the movement of your hand in real time.
Inside of the Oculus menu screens, here are some universal hand gestures which you can use:
|Point and Pinch||Select||Point ahead at something until a cursor appears and then pinch your thumb and finger together to select.|
|Pinch and Scroll||Scrolling||Pinch your index and thumb finger inward and move up, down, left, or right to scroll.|
|Palm Pinch||Go back to Oculus Home||Point your palm at yourself at eye left and hold your thumb and index finger together until the Oculus icon fills up and then release.|
Here are some demo GIFs to help you learn each gesture.
Point and pinch:
Pinch and scroll:
How to Turn Hand Tracking On/Off
Hand Tracking can be toggled on or off easily in the Quest settings:
- From the Oculus Quest home screen, select Settings.
- Click on Devices.
- Select Hands and Controllers.
- Under the Hand Tracking section, you can turn Oculus Quest Hand Tracking on or off.
In this screen, you can also turn auto switching on or off. If auto switching is on, the Oculus Quest will automatically detect and switch between hands and controllers. If auto switching is off, then you need to manually enable and disable hand tracking using the button on your universal menu.
Best Games With Hand Tracking on the Oculus Quest
If a game includes functionality for Oculus Quest hand tracking, it will be listed as one of the inputs in the game listing on the Oculus Store. There are not that many games that support the feature. Three games have announced hand tracking support in the future: Walts of the Wizard, Elixir, and The Curious Tale of the Stolen Pets.
Luckily, if you’ve setup SideQuest to sideload onto the Oculus Quest, then you have access to a ton of great games and apps that use hand tracking.
Here are some of the best hand tracking games for the Oculus Quest:
UPDATED: July 1, 2020
The Curious Tale of the Stolen Pets
The Curious Tale of the Stolen Pets was one of the first games in the official Oculus store to add full hand tracking support. In this game, you help your grandfather solve different mysteries to find stolen pets. You use your hands as a god-like character to move, manipulate, and interact with miniature worlds in front of you.
Curious Tale is a really awesome introduction to hand tracking on the Oculus Quest. Gameplay is light, fun, and interesting. Puzzles are not too hard to solve, which is nice for casual players. Hand tracking is simple enough to learn but takes some time to master.
A lot of hand tracking demos so far only live on Sidequest. If you want to jump in to an official Oculus game and go, Curious Tale is our #1 pick.
Hand Physics Lab
Hand Physics Lab is an excellent starting point for hand tracking. This experience showcases a ton of different ways that you can use your hands in real time without any controllers, including:
- Interactive Buttons and Controllers
- Tools (Hammer, Knife, Crowbar)
- Building blocks
- Drawing board
- Egg Painting Station
- Weight lifting
- Interactive Puppet
- Telekinesis and Force Fields
A few minutes in Hand Physics Lab will have you really excited at the possibilities of this feature in VR! Hand Physics Lab is available to sideload from SideQuest. If you don’t know what that means, check out our SideQuest and top SideQuest games guides.
VRWorkout is a VR fitness game that lets you burn calories in virtual reality. Unlike other VR workout games like BoxVR which force you to use Touch controllers, VRWorkout can be done with only your hands!
The game uses hand tracking to count reps and effort in the game, which is a cool behind-the-scenes way to use the technology. You work through a series of different workouts where you have to jump, squat, do pushups, side plans, crunches, running, and burpees.
VRWorkout is also a game that you sideload from SideQuest. We have a full guide on VRWorkout here.
Cubism is a puzzle game where you have to fit colored blocks into a specified space. The game is a demo fo a future full release that is going to come.
Cubism recently introduced hand tracking as a feature so that you can pinch and move your hands to manipulate blocks on the screen. It’s a good demo of how you can use your hands to play VR without the Oculus controllers.
Sideload Cubism onto your device from SideQuest.
If you’ve ever wanted to learn how to play piano in VR, then VRtuous is for you. The game uses hand tracking EXCLUSIVELY to teach you. This is a great demo to see how accurate the feature is for Quest headsets.
The game needs you to place your hands on a real piano first in order to track accurately. If you can do that, then you can use your hands in VR. After that, you can import your own music and learn new songs on the piano in real time.
Richie’s Plank Experience
Richie’s Plank Experience is one of the original VR games. It is a psychological experience where you have to take an elevator to the roof of a tall building and then walk a plank over and above a city. The game is very popular for new VR beginners and is popular to show off to friends.
The latest version of Richie’s now supports Oculus Quest hand tracking! This means that you don’t have to tether the controllers to your hands to try out this unique game. Simply put your headset on and do everything else with your hands.
Virtual Desktop is an awesome tool that you can use to view media and play VR games stored on your computer wirelessly. We’ve written a full guide on how to get setup with Virtual Desktop on Oculus Quest if you are inteested.
Virtual Desktop now supports hand tracking as well. Not only can you use your hands to navigate your computer, but controls are also extended to PCVR games experimentally! This means that you can try out hand tracking on tons of other games that aren’t meant to be run that way.
What is your favorite Oculus Quest hand tracking experience?
If you have a best hand tracking game to share with us, do it down below in the comments!