MocapFusion (@MocapFusion) profile picture

MocapFusion

@MocapFusion

Motion Capture VR Fusion

Joined August 2021
  • Tweets78
  • Following2
  • Followers233
55Media
Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)Photo by MocapFusion (@MocapFusion)
Ai that learned to act like a shoulder tracker. The model was trained on several hours of mocap I recorded using physical shoulder trackers for ground-truth, the RNN was rewarded for predicting the shrug height seeing only the elbow tracker, and got it, @Blender @unity @SteamVR
4
26
2
510
19,558
No more need for expensive shoulder trackers!!
1
751
Replying to @MocapFusion @Blender @unity @SteamVR
Now available in the latest "Future Version" branch (v11.0.7) on Steam: store.steampowered.com/app/1…
1
11
943
AI that fixes avatar feet tracking in real-time, trained on 2 hours of full body mocap, walk + run + jump + idle. The NN learned to lock the feet in real-time to remove tracker drift/wobble without modifying the user pose. @Blender @unity @UnrealEngine @htcvive @SteamVR
12
82
6
855
58,429
!! Wireless Shoes + custom UI developed in Unity - contact force measurement in real-time for a research project. @unity @arduino @ASICSamerica check my discord for more: discord.com/invite/ErZcKaQ
1
1
9
533
The results turned out pretty good , the network learned to denoise the feet tracking , wobble , feet slip .. I tried the AI denoiser wearing just elastic tracker straps and the model generalized beautifully . the sensor shoes helped the training !! youtu.be/Lrfy91usgCQ
AI Feet-Denoiser - AI that fixes avatar feet tracker wobble in real...

AI Feet-Denoiser - AI that fixes avatar feet tracker wobble in real...

This is a concept neural network (RNN) I trained to remove noise an...

youtube.com
1
1
579
First trained model, looks like the shoes actually learned something !! @unity @blender @arduino and @ASICSamerica The lock i︎con shows when the network predicts the feet should be on the ground:
1
390
AI shoes - training my shoes for footfall prediction in real-time using @unity @Blender and ml-agents, mocap recorded on a pair of Asics Nova shoes + Vive trackers + wireless @arduino boards + force sensors. Check out my discord for more infoz: discord.com/invite/ErZcKaQ
1
2
328
The shoes are learning !!!!
261
You can Walk anywhere on Earth using a VR Treadmill and Cesium Ion🌍 Check out my fully working VR Treadmill: youtu.be/dqjEVryXiIs
1
493
Valve Index Controllers changing speed of a programmable VR treadmill after adding Arduino and Ethernet shield
1
1
7
383
3d printed encoder on a treadmill, making this for recording walking mocap
1
1
11
1,499
V977 update on Steam!!! Improvements made to Arm/Leg IK solvers. Animations rendered in Blender Cycles😃
1
8
324
VR Full Body Tracking + Feet Physics Collisions in realtime. Avatar's feet can collide without clipping, the foot bends to stay flat to the surface (this was achieved using a simple joint system):
1
1
13
1,452
Image from MocapFusion (@MocapFusion)
1
215
ATLAS in the park - animation I rendered in Cycles
3
213
NEW Recordable Physics Doors update (mocapfusion.com/tutorials/do…) this was recorded, exported and quickly rendered in Blender Cycles at very low res, this was only for a tutorial
4
186
Recorded using the new Recordable Door Physics (mocapfusion.com/tutorials/do…) exported and quickly rendered in Blender Cycles at very low res since this was only for a tutorial
2
189
NEW VTuber Deck was just added for triggering text and other cool effects on live stream avatars. Check out the new live-streamer VTuber Mode on Steam!! store.steampowered.com/app/1…
3
147
Just finished working on a new image effect shaders in Unity that renders a VTuber avatar to-hidden when the streamer appears
2
151
Load more