A futuristic real-time hand-tracking AR experience built using MediaPipe + JavaScript. This project transforms your hand movements into dynamic neon visuals, particle effects, gesture-based interactions, and reactive audio.
neon-hand-gesture-visualizer/
โ
โโโ index.html # Main UI structure
โโโ main.js # Core logic (hand tracking, effects, audio)
โโโ app.css # Styling & UI design
โโโ LICENSE
โโโ README.md # Project documentation- Uses MediaPipe Hands
- Detects up to 2 hands simultaneously
- Tracks 21 landmarks per hand
- ๐ค Pinch Detection (Thumb + Index)
- โ Open Hand Detection
- โ Fist Detection
- Live gesture feedback on screen
- Glowing hand skeleton rendering
- Dynamic color themes
- Smooth motion trails
- Gradient-based lighting effects
- ๐ฅ Shockwave effect on pinch
- โจ Particle system from fingertips
- โก Lightning between both hands
- ๐ Mandala-style pattern rendering
- Animated matrix rain effect
- Speed reacts to hand movement velocity
- Creates immersive cyberpunk feel
- Built using Web Audio API
- ๐ต Ambient hum sound (based on hand distance)
- โก Zap sound on pinch gesture
- Real-time audio modulation
- Rainbow ๐
- Cyberpunk ๐
- Lava ๐ฅ
- Ocean ๐
- Galaxy ๐
- Hands detected
- FPS counter
- Current gesture
- Hand spread %
| Technology | Role |
|---|---|
| JavaScript | Core logic & interaction |
| MediaPipe Hands | Hand tracking (AI model) |
| HTML5 Canvas | Rendering visuals & effects |
| Web Audio API | Sound generation |
| CSS3 | UI styling (Glassmorphism) |
- Modern browser
- Webcam access required
- Internet (for CDN libraries)
git clone https://github.com/ShakalBhau0001/neon-hand-gesture-visualizer.gitcd neon-hand-gesture-visualizer- Open
index.htmlin browser - Allow camera permission
- Click Enter Experience
- ๐ฅ Live camera feed (mirrored)
- โ Hand skeleton with neon glow
- โจ Particles from fingertips
- โก Lightning between hands
- ๐ง๏ธ Matrix-style animated background
- ๐ Live HUD with stats
- MediaPipe processes video frames
- Detects hand landmarks in real-time
- Calculates distance between fingers
- Identifies pinch, open hand, fist
-
Canvas draws:
- Skeleton
- Particles
- Shockwaves
- Lightning
- Generates real-time sound
- Reacts to gesture & hand distance
- Requires good lighting for accurate detection
- Performance depends on device GPU/CPU
- Mobile support limited
- ๐ฑ Mobile optimization
- ๐ง More advanced gestures
- ๐ Three.js 3D integration
- ๐ฅ Recording / export feature
- ๐ฎ Gesture-based controls
Creator: Shakal Bhau
GitHub: ShakalBhau0001
If you like this project:
- โญ Star the repo
- ๐ด Fork it
- ๐ Share it
โจ Move your hands. Create magic. โจ