🎸Guitarist Vtuber 🤘 3D guitar motion capture 🔥 Virtual Band 🎨 PFP by @fluffu_art
Joined June 2023
- Tweets2.2K
- Following1.6K
- Followers15.9K
- Likes18.7K
Pinned Tweet
Is this the most complete VTuber guitar mocap you’ve seen?
Full vocal + guitar. 🎤🎸
Fingers, body, face, strap, live strings.
What should we add next? ✨
#GuitarMocap #ギタリストVTuber
Guitar Mocap! Sophie - Ave Mujica 🎸
Remade my guitar performance with all the new tools and pipeline upgrades I've built over the past year! Notice any progress? ✨
I also tried to add lighting and some camerawork, hoping to showcase more performance details! Hope you like it! 🤘
#GuitarMocap #ギタリストVTuber #AveMujica
Finished a guitar mocap video without guitar or finger tracking in 6 minutes! 🎸✨
Here’s the full workflow recording of mocha Lite.
It generates matching guitar and finger animation for character motion data.
⚠️ Note: It’s made for offline video production, not real-time. The current calculation is entirely based on my own past mocap guitar data, so I’m not sure how well it works with other people’s recordings or different playing styles. I’ll keep testing to see if it can be more universal!
Made a tool that automatically generates a natural guitar animation and finger animations to match your normal playing character animation. 🎸
No fancy tracking setup needed.
Gonna call it Mocha (chacha Mocap) Lite hahahaha😉
Anyone interested?
#GuitarMocap
Made a tool that automatically generates a natural guitar animation and finger animations to match your normal playing character animation. 🎸
No fancy tracking setup needed.
Gonna call it Mocha (chacha Mocap) Lite hahahaha😉
Anyone interested?
#GuitarMocap
They say if you don’t look at the head, at first glance you’d think I’m real.
3 close-up angles real guitarists often use, let’s see what they look like in the virtual world!
#GuitarMocap #ギタリストVTuber
Sharing a quick detail behind this video.🎸
One problem I kept running into was that sometimes fingers weren't clipping, they were slightly floating above the fretboard.
So I built ‘Finger Contact’, a tool that reads Guitar Pro tabs to pull active fretting fingers precisely onto the strings, without breaking the original mocap.
Since Leap Motion can't track finger hyperextension well while playing, I also added a feature to automatically flatten the index finger joint for real barre chords (check the OFF/ON test!)
#GuitarMocap #ギタリストVTuber
Guitar Mocap! KiLLKiSS - Ave Mujica 🎸
Processed nearly 2-year-old mocap data with my latest setup. How does it look?
Made this one for a recent interview.
#GuitarMocap #ギタリストVTuber
Guitar Mocap! KiLLKiSS - Ave Mujica 🎸
Processed nearly 2-year-old mocap data with my latest setup. How does it look?
Made this one for a recent interview.
#GuitarMocap #ギタリストVTuber
Big thanks to @vtubervibes886 for having me!
vtubervibes.com/chacha-guita…
Guitar mocap cleanup, full workflow is here!🔥
1-hour process! Zero keyframes!🤯
Finger fixes, guitar fixes, skin groove, string dynamics, strap, all in one video!
ギターモキャプ後処理、フルワークフロー公開！
1時間の工程！キーフレーム0！
指修正・ギター修正・skin groove・弦の動き・ストラップ、全部入り。
#GuitarMocap #ギタリストVTuber
New feature: Skin Groove! 🎸🖐️
The edge of the guitar neck now presses a groove into the finger, the way real skin would compress, instead of clipping through it! 😮
That means I can use less anti-clipping push-off, so the fingers sit closer to the neck and the pose looks more natural! ✨
But why do I always build the new feature after the video goes out… 😭
What if I told you there is ZERO manual keyframing in this video? 🤯
I’ve been building custom tools for guitar mocap cleanup. This is my first 100% automated, zero-keyframe result:
👍 Thumb Pose Estimation:
Automatically predicts thumb posture across different neck positions and wrist shapes, based on patterns from past manual cleanups. No more clipping.
✊ Grip Tightness Adjustment:
Tightens the overall hand grip without killing subtle motion. Fixes floating fingers.
✋ Right-Hand Picking Alignment:
Locks picking to the strings and dynamically adjusts when the guitar body gets close to the torso. No more floating guitar.
🖐️ Auto Finger Clipping Correction:
Detects fingers clipping into the fretboard and pulls them out automatically.
Thanks to these tools, the process isn’t very long, would you guys be interested in a screen recording of the workflow?
#GuitarMocap #ギタリストVTuber
What if I told you there is ZERO manual keyframing in this video? 🤯
I’ve been building custom tools for guitar mocap cleanup. This is my first 100% automated, zero-keyframe result:
👍 Thumb Pose Estimation:
Automatically predicts thumb posture across different neck positions and wrist shapes, based on patterns from past manual cleanups. No more clipping.
✊ Grip Tightness Adjustment:
Tightens the overall hand grip without killing subtle motion. Fixes floating fingers.
✋ Right-Hand Picking Alignment:
Locks picking to the strings and dynamically adjusts when the guitar body gets close to the torso. No more floating guitar.
🖐️ Auto Finger Clipping Correction:
Detects fingers clipping into the fretboard and pulls them out automatically.
Thanks to these tools, the process isn’t very long, would you guys be interested in a screen recording of the workflow?
#GuitarMocap #ギタリストVTuber
HOLY SHIT what did I just build! 😱
Guitar Pro tabs → virtual guitar string dynamics
Per string! Per fret! Fully automatic! 🎸
Just write the tab!
No more placing every single note by hand!
-----
Collab with a friend on this song!!✨
Coming soon! 👀
#GuitarMocap
🎸 Picking position was just slightly off — tiny mocap calibration misses.
So I built Picking Correction.
Adjust right hand position and depth, with hand/arm avoidance so nothing clips.
ON vs OFF 🔥
#GuitarMocap #ギタリストVTuber
Is this the most complete VTuber guitar mocap you’ve seen?
Full vocal + guitar. 🎤🎸
Fingers, body, face, strap, live strings.
What should we add next? ✨
#GuitarMocap #ギタリストVTuber
Guitar Mocap! 🎸
Seeing the virtual guitar strings bend and vibrate still feels like absolute magic! So proud of how this turned out! ✨
#GuitarMocap #ギタリストVTuber
#WutheringWaves #鳴潮
A question I’ve been getting quite often lately:
“Do you plan to release or sell your guitar mocap tools?”
Honestly, the tools aren’t ready for release yet — and it’s not just about polish.
They work best when the raw mocap data is already of decent quality, and even then, the most critical adjustments still rely heavily on a feel for playing, weight, inertia, and how the guitar interacts with the body and clothing. A lot of that is hard to transfer without the right background.
Because of this, I’ve been thinking that for most people, it might actually be more practical to have me handle the mocap data processing directly, rather than spending months working through a complex workflow.
So for now, I’d prefer offering a guitar mocap data processing service as a first step.
If that’s something you’d be interested in, let me know.
Introducing my String Dynamics System!🎸
I’ve created 3 different modes for different playing techniques:
🌟1. Bending & Vibrato — Deformation Mode
Controls bend direction, intensity, and exact bend point.
Set the vibrato count, and it generates a matching envelope curve that keeps string movement perfectly synced with finger motion.
🌟2. Palm Muting — Pulse Glow Mode
Driven by BPM to produce short, rhythmic light pulses synced with right-hand picking. I used short pulses over vibration because real muted notes produce minimal sustained string movement.
🌟3. Strumming — Vibration Mode
Full control over vibration range, amplitude, frequency, and phase. String glow scales dynamically with deformation to simulate real-time light reflection changes.
All 3 modes are based on pure shader vertex deformation, stable, reliable, and fully controllable!
What do you think?😘
If you’re curious what the pipeline actually covers:
• Guitar calibration
• Character-guitar synchronized recording
• Motion smoothing
• Leg IK correction
• Right-hand picking position adjustment
• Left-hand finger auto-fix
• Thumb cylindrical adhesion
• Gaze tracking
• String dynamics system
• Shader-based glowing strap
Introducing my String Dynamics System!🎸
I’ve created 3 different modes for different playing techniques:
🌟1. Bending & Vibrato — Deformation Mode
Controls bend direction, intensity, and exact bend point.
Set the vibrato count, and it generates a matching envelope curve that keeps string movement perfectly synced with finger motion.
🌟2. Palm Muting — Pulse Glow Mode
Driven by BPM to produce short, rhythmic light pulses synced with right-hand picking. I used short pulses over vibration because real muted notes produce minimal sustained string movement.
🌟3. Strumming — Vibration Mode
Full control over vibration range, amplitude, frequency, and phase. String glow scales dynamically with deformation to simulate real-time light reflection changes.
All 3 modes are based on pure shader vertex deformation, stable, reliable, and fully controllable!
What do you think?😘
