Think, Talk, Drive
Welcome to the GenAI and LLMs STEM Workshop. Over five days, you will go from unboxing your robot to having a full conversation with an AI that can see, hear, speak, and physically move.This is a fully virtual camp. Your robot kit has been shipped to you pre-assembled with an SD card, card reader, and WiFi dongle included.
What you will build
By the end of this week, your robot will be able to:- Move on command using keyboard controls and programmed sequences
- Speak using text-to-speech, announcing its actions aloud
- Follow lines autonomously using onboard sensors
- Detect colors and faces with classical computer vision
- Hold a conversation by connecting to a large language model
- See and describe its surroundings using a vision language model
- Act on what it sees by combining vision AI with physical tool calls
Your week at a glance
Day 1: Setup and Calibration
Flash your SD card, connect to your robot over SSH, calibrate servos, and validate all sensors.
Day 2: Programs and Computer Vision
Write movement programs, give the robot a voice with text-to-speech, follow lines, and detect colors.
Day 3: GenAI and Cloud LLMs
Learn how large language models work, connect to the OpenAI API, build a voice chatbot, and control the robot with LLM tool calls.
Day 4: Vision AI
Feed the robot’s camera into a vision language model so it can describe what it sees and act on visual information.
Hardware overview
Your robot kit includes:| Component | Purpose |
|---|---|
| Raspberry Pi | The brain of the robot, runs all code |
| Robot HAT | Motor and sensor controller board |
| 2-axis camera module | Pan and tilt camera for vision |
| Ultrasonic sensor | Measures distance to obstacles |
| Grayscale/line-tracking sensor | Detects light and dark surfaces for line following |
| Speaker | Audio output for text-to-speech |
| Microphone | Voice input for speech-to-text |
| Wheels and servos | Steering and movement |
Before you start
Confirm your kit contains: robot (pre-assembled), SD card, SD card reader, and WiFi dongle.