Hand Wave

Sign recognition for web and iOS, backed by a small Python inference service.

Watch the demo on YouTube

Setup

Requirements: pnpm 10.33+, Node 22+, Python 3.11/3.12, uv, and moon.

cp .env.example .env
pnpm install
uv sync --project apps/inference

Don't forget to set VITE_INFERENCE_URL in .env.

Development

pnpm dev

Research Credits

• Questure Tracker
• MiCT-RANet for ASL Fingerspelling
• A Two-Stream Neural Network for Pose-Based Handshape Recognition in American Sign Language
• Mixed 3D/2D Convolutional Tube for Human Action Recognition
• Fingerspelling Recognition in the Wild with Iterative Visual Attention
• FSBoard: Over 3 million characters of ASL fingerspelling collected via smartphones