Skip to main content

Roadmap

User Interaction
✓
Natural Language Interface
Complete
Complete set of natural language interfaces through ASR and TTS.
JanFebMarAprMayJunJulAugSepOctNovDec
TTS Service
ASR Service
EMA + Wake Phrase
✓
Visual Perception Interface
Complete
Complete visual perception interface covering the robot's on-screen face and its continuous understanding of the scene.
JanFebMarAprMayJunJulAugSepOctNovDec
GUI Display
VTT Service
Caption Filtering
✓
Touch Interface
Complete
Direct physical interaction through the robot's front touchscreen, from raw touch events to reactive behaviour.
JanFebMarAprMayJunJulAugSepOctNovDec
Touchscreen Input
Tap Routing
Touch Reactions
✓
Visualization Interface
Complete
A simple UI and API allowing users and researchers to query the robot's world model and observe its internal state.
JanFebMarAprMayJunJulAugSepOctNovDec
Backend API
Dashboard Bridge
Dashboard
Locomotion
✓
Wheeled Locomotion
Complete
Full autonomous navigation on the wheeled platform.
JanFebMarAprMayJunJulAugSepOctNovDec
3D Mapping
Navigation Stack
Motor Control
Navigation Testing
○
Legged Locomotion
Planned
Implement and validate robust gait control for stable standing and walking, ensuring dynamic balance and recovery from disturbances.
JanFebMarAprMayJunJulAugSepOctNovDec
Gait Controller
Balance & Stability
Recovery Behaviors
Validation Testing
Robot Intelligence
✓
Digital Twin Foundation
Complete
Unified data structure for hardware, sensor state, and environment, supporting real-time data streaming and low-latency update loops.
JanFebMarAprMayJunJulAugSepOctNovDec
Messaging Schema
Internal Messaging
Hardware Monitor
Data Streaming
✓
VLM Reasoning Engine
Complete
Core cognitive engine that integrates visual and linguistic information to generate context-aware responses and actions through tool calls.
JanFebMarAprMayJunJulAugSepOctNovDec
Prompt Engineering
Tool Integration
Response Generation
Testing & Iteration
◐
Memory System
In Progress
Graph-based memory system supporting recall, consolidation, and forgetting.
JanFebMarAprMayJunJulAugSepOctNovDec
Storage & Encoding
Hybrid Retrieval
Consolidate & Forget
Metacognitive Layer
Salience, Surprise, Emotion
Domain-Specific Memories
Refinement & Iteration
✓
Self-Improvement Routine
Complete
Automated process for the robot to analyze its own performance, identify weaknesses, and iteratively improve through targeted code and training updates.
JanFebMarAprMayJunJulAugSepOctNovDec
Performance Analysis
Improvement Planning
Targeted Updates
✓
Physics-Aware Simulation & Generation
Complete
Set up the simulation environment and integrate generative frameworks to enable what-if scenario simulation and reasoning.
JanFebMarAprMayJunJulAugSepOctNovDec
Simulation Environment
Generative World Model
Scenario Generation
Mechanical & Electrical
✓
Cube Module
Complete
Initial design, build, and wiring for the cube: compute enclosure, sensor and camera mounts, and compute power.
JanFebMarAprMayJunJulAugSepOctNovDec
CAD Creation
3D Printing
Mechanical Assembly
Electrical Wiring
Redesign & Rebuild
◐
Wheeled Module
In Progress
Initial design, build, and wiring for the wheeled base: chassis, drive motors, motor controllers, and microcontrollers.
JanFebMarAprMayJunJulAugSepOctNovDec
CAD Creation
3D Printing
Mechanical Assembly
Electrical Wiring
Redesign & Rebuild
○
Cargo Module
Planned
Passive cargo compartment mounted to the chassis for carrying items between locations.
JanFebMarAprMayJunJulAugSepOctNovDec
Mount & Enclosure Design
Retention & Access
Fabrication & Validation
System Validation
✓
Robot-to-Twin Fidelity
Complete
Verify that the robot's real-world mechanics (mass distribution, joint configurations) match what is represented in the digital twin.
JanFebMarAprMayJunJulAugSepOctNovDec
Mass Distribution
Joint Config Check
Real vs. Twin Diff
Research & Validation
◐
Evaluation Metrics
In Progress
Define metrics for self-understanding and prediction accuracy to validate the robot's behavior.
JanFebMarAprMayJunJulAugSepOctNovDec
Metric Definition
Baseline Runs
Validation Protocol