Skip to content
RobothecaBeta
Log in

Smart Dexterous Hand - Gesture Recognition Music Control System

An open-source dexterous hand system that uses gesture recognition to control a 3D-printed robotic hand and play music.

  • Robot arm
  • No license: all rights reserved by the creator
  • Work in progress
  • arduino
  • 3D printable

Suggested by Robotheca, created by @HBC-Tech-coder (opens in a new tab), from github.com/HBC-Tech-coder/RobotHand (opens in a new tab). Pinned to commit 7bbbfff (opens in a new tab).

Fork on GitHub (opens in a new tab)Download the files at this commit (.zip)
Hardware license
No license
Software license
No license
Commercial use
Unknown

No license is stated for part of this robot.

The creator chose the hardware and software licenses on Robotheca; the repository has no license file for them yet.

This repository contains executable files that Robotheca doesn't check. Only run them if you trust the creator.

Which files (1 script, 1 program or installer)

Photo and 3D model

This repository has no photo of the robot yet.

3D model loaded from the original files on GitHub at 7bbbfff, under NONE. View the original files from GitHub (24.8 MB) (opens in a new tab)

What it can do

Written by Robotheca from the project's documents.

  • Recognizes hand gestures in real time using a camera
  • Controls a robotic hand to mimic detected hand gestures
  • Plays music by mapping finger bending to musical notes
  • Runs an interactive rhythm game based on the song "沧海一声笑"
  • Supports three modes: gesture recognition, music performance, and game mode

Bill of materials

This repository has no parts list Robotheca can read yet.

Build guide

The creator's steps, each with its instructions.

  1. 13D print all parts
  2. 2Purchase electronic components from BOM
  3. 3Solder the circuit board
  4. 4Assemble the mechanical structure
  5. 5Flash firmware and connect to computer

The creator's guide is written in Chinese. It has no license, so all rights stay with the creator: Robotheca doesn't show it here or translate it, and gives its own notes about the robot instead.

Read the creator's guideAsk the creator on GitHub (opens in a new tab)

More guides

Wiring and electronics

Notes written by Robotheca from the project's documents.

Main parts

  • Arduino or ESP32 microcontroller
  • Servo motors for finger movement
  • Camera for hand gesture recognition
  • Speaker or audio output for music playback

Connections

  • Servo motors connected to microcontroller PWM pins
  • Camera connected via USB or GPIO
  • Speaker connected to audio output pins or external amplifier

Schematics, boards and diagrams