Project files

🐳 WhaleBot Smart Whale Car (ESP32-S3 AI Robot)

WhaleBot is a holonomic mobile AI robot project based on the ESP32-S3. It integrates the Coze large model, Baidu voice technology, Mecanum wheel holonomic motion control, and a UART touchscreen, achieving a seamless smart interaction experience with "listen, speak, think, move, and see" capabilities.

🤝 Datawhale x StarCore Workshop | AI Hardware Follow-up Study

📚 Development Tutorial (Documentation)

This project has joined forces with Datawhale, China's largest AI open-source community, to launch the "AI Hardware Beginner Follow-up Study" activity!

Datawhale is dedicated to building an open-source community "For the learner," bringing together numerous experts and enthusiasts in the AI field.

This course will guide everyone from scratch to build their own AI robot from scratch.

We have written a nanny-level development tutorial covering hardware selection, PCB design principles, code annotations, and assembly tutorials, and will follow up with video tutorials.

👉 DataWhale official course link: https://www.datawhale.cn/learn/summary/268 (opens in a new tab) 👈

👉 DataWhale follow-up study group 👈

What if the follow-up study group is already full? No problem! You can join our project communication WeChat group to receive technical and hardware support!

🛍️ Beginner-Friendly Kit

To spare beginners the hassle of slow component procurement and buying the wrong models, we offer a one-stop full kit (including 3D-printed shells, finished/semi-finished PCBs, motors, batteries, and all electronic components). Material updates will be synchronized in the official study group and our project discussion group—feel free to ask questions in the group!

🛠️ Hardware Architecture

Parts List

• Main Controller: ESP32-S3-DevKitC (N16R8)
• Driver: 2 × TB6612FNG
• Actuator: 4 × N20 geared motor (12 V 300 RPM) + 4 × Mecanum wheels (one set)
• Audio: INMP441 microphone + MAX98357A amplifier
• Power: 12 V lithium battery + TPS5430 buck converter module
• Interaction: Serial touchscreen / Tianwen ASRPRO development board
• ps: If you need to purchase electronic components yourself, please refer to the “Datawhale official website development tutorial” (hereinafter referred to as “tutorial”) Chapter 1 “Hardware needed for DIY” for recommended purchases.
• Enclosure: See docs/enclosure_print_files for details
• PCB: See hardware/PCB and schematic for details

💻 Replica: Quick Start Guide

I. Assembly of the Hardware Components

1. Prepare the PCB board and connect the electronic components according to the pin positions indicated on the board. Note: If you are making the PCB yourself, refer to the BOM table in hardware/ to purchase the relevant electronic components and solder them yourself.
2. Assemble the casing. The front, rear, and bottom plates of the casing have fixed stickers for easy disassembly and debugging. For the casing files, see docs/外壳打印.

II. ESP32-S3 Program Section

1. Download Arduino IDE (recommended version 2.1.4 or later).
2. Download the ESP32 chip package. The offline download package is located at firmware/esp32 chip package. If you don't know how to download it offline, refer to Chapter 3 "Software Section" in the "Tutorial".
3. Install the following support libraries: <base64.hpp> (recommended version 1.3.0) <ArduinoJson.h> (recommended version 7.4.1) <UrlEncode.h> (recommended version 1.0.1)
4. Before flashing the code, check the corresponding options as shown in the image below!! The code file is located at firmware/WhaleBot_Main.ino.

🤝 Acknowledgments

This project was initiated and developed by the MeetAI Lab over a 9-month period, culminating in the successful creation of the WhaleBot AI whale car and a complete set of tutorials. We would like to express our heartfelt gratitude to the Datawhale community, all the developers who participated in the project, and the teachers and colleagues who provided assistance. The MeetAI Lab is a laboratory from the College of Computer Science at Fuzhou University, established in 2024, dedicated to creating a fun, engaging, and diverse 104.

Developers of the lab

List of Developers

Project Leader: Lin Gaoxuan

Project Development: Lin Gaoxuan, Shang Qifeng, Xie Haozhe

Secondary Development: Lin Gaoxuan, Neil·Bauman, Maomaocao, gtxylt, kyle

Tutorial Production: Lin Gaoxuan, kyle, Xiaoban, Qingshi & Kong, Neil·Bauman, Maomaocao, Li Shiyu, Liu Xuanyou

If you find this project interesting, please click the ⭐️ Star in the top-right corner to support us!

📄 License

MIT License © 2024 StarChip Workshop (星芯工坊)