Roadmap

If you are part of the team, more details can be found in the Team Backlogs.

User Interaction

✓

Natural Language Interface

Complete

Complete set of natural language interfaces through ASR and TTS.

JanFebMarAprMayJunJulAugSepOctNovDec

TTS Node

ASR Node

EMA + Wake Phrase

✓

Visual Perception Interface

Complete

Complete visual perception interface through VTT.

JanFebMarAprMayJunJulAugSepOctNovDec

GUI Node

VTT Node

Caption Filtering

✓

Visualization Interface

Complete

A simple UI and API allowing users and researchers to query the robot's world model and observe its internal state.

JanFebMarAprMayJunJulAugSepOctNovDec

Backend API

ROS Bridge

Dashboard

Locomotion

✓

Wheeled Locomotion

Complete

Full navigation stack via ROS 2.

JanFebMarAprMayJunJulAugSepOctNovDec

3D Mapping

Navigation Stack

Motor Control

Navigation Testing

○

Legged Locomotion

Planned

Implement and validate robust gait control for stable standing and walking, ensuring dynamic balance and recovery from disturbances.

JanFebMarAprMayJunJulAugSepOctNovDec

Gait Controller

Balance & Stability

Recovery Behaviors

Validation Testing

Robot Intelligence

✓

Digital Twin Foundation

Complete

Unified data structure for hardware, sensor state, and environment, supporting real-time data streaming and low-latency update loops.

JanFebMarAprMayJunJulAugSepOctNovDec

ROS 2 Topic Schema

ROS 2 Middleware

Hardware Monitor

Data Streaming

✓

VLM Reasoning Engine

Complete

Core cognitive engine that integrates visual and linguistic information to generate context-aware responses and actions through tool calls.

JanFebMarAprMayJunJulAugSepOctNovDec

Prompt Engineering

Tool Integration

Response Generation

Testing & Iteration

◐

Self-Improvement Routine

In Progress

Automated process for the robot to analyze its own performance, identify weaknesses, and iteratively improve through targeted code and training updates.

JanFebMarAprMayJunJulAugSepOctNovDec

Performance Analysis

Improvement Planning

Targeted Updates

○

Physics-Aware Simulation

Planned

Set up the simulation environment and integrate generative frameworks to enable what-if scenario simulation and reasoning.

JanFebMarAprMayJunJulAugSepOctNovDec

Simulation Environment

Generative World Model

Scenario Generation

Mechanical & Electrical

✓

Mechanical & Electrical

Complete

Initial subsystem design, build, and wiring for the wheeled prototype.

JanFebMarAprMayJunJulAugSepOctNovDec

CAD Creation

3D Printing

Mechanical Assembly

Electrical Wiring

System Validation

✓

Robot-to-Twin Fidelity

Complete

Verify that the robot's real-world mechanics (mass distribution, joint configurations) match what is represented in the digital twin.

JanFebMarAprMayJunJulAugSepOctNovDec

Mass Distribution

Joint Config Check

Real vs. Twin Diff

Research & Validation

○

Evaluation Metrics

Planned

Define metrics for self-understanding and prediction accuracy to validate the robot's behavior.

JanFebMarAprMayJunJulAugSepOctNovDec

Metric Definition

Baseline Runs

Validation Protocol