Skip to content
โ† Rush Mog

Project files

README.md

Machine-translated by Robotheca from the original in Chinese (opens in a new tab). License: Apache-2.0 (opens in a new tab).

1 Overall Software Architecture

The RushMog intelligent system consists of six core subsystems: voice control system, vehicle control system, visual analysis system, remote control center system, LiDAR system, and VLA inference system, and robotic arm system.

  • Voice Control System: Recognizes voice commands, converts them into execution instructions, and sends them to the main control system for execution. (Originally planned to use the asr-pro on-board control, but the car's motor noise was too loud, resulting in poor performance. Switched to terminal control.)
  • Vehicle Control System: Uses an STM32 single-board computer to control the vehicle's movement, sound, and robotic arm based on voice commands and PS2 controller inputs.
  • Remote Control Center System: Provides Wi-Fi for terminal connections, hosts a web server for the PS2 controller interface, receives camera monitoring images, and pushes them to the terminal PS2 interface. It also provides simulated PS2 controller command operations.
  • LiDAR System: To be implemented
  • VLA Inference System: To be implemented
  • Robotic Arm System: To be implemented

architechture.png

2 Control Commands

Voice CommandController CommandFunctionCommand IDIndicator Light
Stop / Don't goRelease all buttons on the leftCar stops0
Forward / Goโ†‘ key, or left stick upCar moves forward1
Backwardโ†“ key, or left stick downCar moves backward2
Move leftโ† key, or left stick leftCar moves left laterally3
Move rightโ†’ key, or left stick rightCar moves right laterally4
Move front-leftLeft stick top-leftCar moves diagonally front-left5
Move front-rightLeft stick top-rightCar moves diagonally front-right6
Move back-leftLeft stick bottom-leftCar moves diagonally back-left7
Move back-rightLeft stick bottom-rightCar moves diagonally back-right8
Turn leftL1 buttonCar turns left9
Turn rightR1 buttonCar turns rightA
U-turn leftL2 buttonCar makes a U-turn from the leftB
U-turn rightR2 buttonCar makes a U-turn from the rightC
Test carSTART keyTest the carD
โ–ณ keyAccelerateE
ร— keyDecelerateF
โ–ก keySlight left turnG
โ—‹ keySlight right turnH
Release โ–ก or โ—‹ keyResume straight movementI
SELECT keyReinitialize the carJ

3 Subsystem Design Description

3.1 Voice Control Subsystem

Voice Control System

3.2 Chassis Control Subsystem

Chassis Control System

Functions of the chassis control subsystem:

  • 1 Receive voice control commands
  • 2 Drive the car motors; each of the four motors drives independently, enabling actions such as moving forward/backward/stopping
  • 3 Interact with the Raspberry Pi/camera, transmit control commands, and receive image analysis results
  • 4 Drive mechanical arm motion control execution

3.3 Remote Control Subsystem

Functions of the remote control subsystem:

  • 1 Connect the camera to collect image data in real time
  • 2 Apply machine learning for image recognition
  • 3 Recognize position and distance
  • 4 Generate control commands and send them to the main control system

4 Related tools and software used:

OS: Ubuntu 20.04
Software Design and Development Tools:

Files by @coregiu, at commit c9d4b8e, read from GitHub in your browser. Hardware license: Apache-2.0; software license: Apache-2.0. Robotheca doesn't review code: read it before running it.