Leap Motion Controller finger tracking for VRChat OSC
Using a Leap Motion Controller from Ultraleap for finger tracking in VRChat without mods.
Description
This project uses two npm packages, leapjs and node-osc, to send finger tracking data from a Leap Motion Controller to VRChat via OSC.
leapmotion-osc.mp4
Getting Started
Dependencies
- VRChat 2022.1.1, build 1167 and up (Open Beta)
- NodeJS
- Leap Motion Orion 3.2.1 (I had problems with the new version of Ultraleap, maybe the new versions work for you)
Installing
- Make sure that your operating system has NodeJS installed and can execute npm commands.
- Clone the repo and run
npm installin its root directory.
Executing program
- Run the script with
npm start.
Additional notes
The default mode for the controllers is optimizeHMD, if you want to use this on a flat surface instead, make sure you set optimizeHMD:true to optimizeHMD:false at the very beginning of the Leap.loop function.
Avatar Setup
Your avatar receives OSC inputs for 10 float parameters that you need to add to your avatar. You also need to create or use the animations provided in the animations repo folder to create blendtrees that transition from the retracted to the extended state of each finger.
- leftThumb (float)
- leftIndex (float)
- leftMiddle (float)
- leftRing (float)
- leftPinky (float)
- rightThumb (float)
- rightIndex (float)
- rightMiddle (float)
- rightRing (float)
- rightPinky (float)
To do this, I created two layers in my gesture layer (one hand each) and added a custom bool parameter called "leapmotion" to turn OSC value playback on and off ingame. I recommend using a threshold of 0.4 to 0.9 for the blendtrees, as I have had the best results with this. Please note that the animations provided in the repo are customized to my avatar and have not been tested on other avatars yet. In the worst case you will have to set up the animations and blendtrees yourself.
You can edit my code at any time to add or remove prefixes or change the name of the fingers as you like.
Contributors
Version History
- 1.0.1
- split distance calculation and OSC sending to separate functions
- 1.0.0
- Pull changes from Zedzeen, cleanup code, update license
- 0.1
- Initial Release
License
MIT License: Check the LICENSE file
https://github.com/SDraw/ml_mods_vrc
it used to be have one
simple plug and use
and one day vrc decide to kill every mod
i already have valve index but i still want leap and finger spread on it
sorry for bothering you and stealing photo form some weird site
i know nothing about coding :/
3 May 18, 2022
34 Jan 1, 2023
4 May 3, 2022
14 Jan 3, 2023
9 Dec 9, 2022
11 Oct 10, 2022
5 Dec 1, 2022
1 Dec 21, 2021
10 Aug 17, 2022
10 Nov 2, 2022
201 Dec 26, 2022
10 Nov 16, 2022
2 Jan 7, 2022
13 May 12, 2022
4 Mar 25, 2022
7 Nov 16, 2022
8 Jun 26, 2022
29 Nov 30, 2022
52 Oct 6, 2022