AeroPuzzle

A jigsaw puzzle you solve with your hands, using real-time webcam hand tracking.

A browser puzzle controlled entirely by hand gestures, using real-time computer vision.

AeroPuzzle tracks your hand through the webcam with MediaPipe and lets you pick up and drop puzzle tiles by pinching in the air. I wrote the gesture maths myself (pinch detection from hand landmarks), ran it in a 60fps canvas loop, and kept performance-critical state in refs to avoid re-render tearing. Built with Next.js, React and TypeScript. The code is public.

  • Role: Creative developer
  • Year: 2026
  • Category: Computer vision
  • Stack: Next.js, React, TypeScript, MediaPipe, Canvas

Source code

AeroPuzzle preview