DEV Community

zhenqi QIU
zhenqi QIU

Posted on

T5-Pocket: Your AI+IoT Smart Companion ,by tuyaopen open sourced platfor

based on

🎮 AI Virtual Pet System
Pet Animations: Rich animations including eating, bathing, sleeping, dancing, getting sick, using bathroom, etc.
State Management: Real-time changes in health, energy, cleanliness, and happiness
Emotion Expression: Happy, sad, sick and other emotions that switch automatically based on state
Interactive Operations: Feeding (burgers, pizza, apples, etc.), bathing, seeing doctor, sleeping, etc.
Smart Timer System: Automatically decreases stats every 20 minutes to simulate real pet needs
Data Persistence: Pet states automatically saved to KV storage, no data loss on power off
Cloud Sync: Real-time status reporting to Tuya Cloud, supports remote viewing and control
💬 Multimodal AI Conversation
4 Conversation Modes:
Push-to-talk single conversation (press to talk, release to send)
VAD free conversation (automatic voice activity detection)
Wake word single conversation (like smart speakers)
Wake word free conversation (continuous dialogue mode)
Emotion Recognition: AI recognizes user emotions (happy, angry, fearful, sad) and adjusts responses
Streaming Text Processing: Supports streaming reception and display of AI responses
Multi-language Support: Chinese and English voice recognition and synthesis
🖥️ UI Interface
Main Screen: Displays pet animations, status bar (Wi-Fi, battery, 4G), pet attributes
Menu System:
Feeding menu (food selection)
Bath menu
Health menu (see doctor)
Sleep menu
Info menu (detailed pet attributes)
Peripheral menu (gyroscope, I2C scan, WiFi scan, games)
Game Interface:
Snake game (fully implemented)
Dino runner game (fully implemented)
Tool Interface:
RFID scanning interface
I2C device scanning interface
Temperature/humidity display
Level meter interface
AI log analysis interface
E-book reader
Keyboard input interface
🎵 Audio System
System Sounds:
Network configuration sounds
Network connection success/failure sounds
Wake-up sounds
Various conversation mode sounds
Pet Sound Effects:
Eating sounds
Bathing sounds
Sick sounds
And more
Volume Control: 0-100 level volume adjustment with cloud sync support
🔌 Extended Features
RFID Card Reader: Supports UID reading and data parsing, CRC16 verification
Thermal Printer: Supports text and image printing, UTF-8 to GBK encoding
AI Log Analysis: Real-time serial log capture with AI intelligent error analysis
BMI270 Gyroscope: Posture detection and step counting
I2C Device Scanning: Automatically scans and displays I2C device addresses
How to Play with T5-Pocket?
T5-Pocket is an open-source project based on TuyaOpen. Users can download source code or firmware from the TuyaOpen official website to implement custom features. The TuyaOpen team provides rich example projects that users can reference to develop their own projects.

Joystick
Overview
T5-Pocket is equipped with a dual-channel joystick and independent button, supporting x, y dual-channel 12-bit precision ADC sampling. It can function as a joystick, knob, or directional pad. The joystick enables more precise UI switching and function selection, along with many hidden gameplay features.

Use Cases
Game Controller: Like common game controllers, you can use the joystick on T5-Pocket to control game character movement. Classic games like Dino Runner and Snake can all be implemented.
Menu Navigation: Use the joystick for more precise UI page switching, including function icon selection, e-book page turning, and flexible page navigation controlled by the joystick.

Top comments (0)