MimicAgent

Quadruped Skills via Prompt-to-Trajectory Generation

Carnegie Mellon University

* Equal contribution

Side view of skating on two legs

Back view of skating on two legs

We visualize never-before-seen skating skills on two legs generated by MimicAgent.

We present MimicAgent, a prompt-to-trajectory generation framework for learning dynamic quadruped skills. Although reward shaping is extensively used when training quadruped policies, navigating the resulting reward landscape is notoriously difficult, requiring hours of “graduate student descent”. Eureka attempts to automate reward design with LLMs, but we find that it struggles to generalize across diverse skills and morphologies. Our key observation is that it is far easier for a human – and by association, an LLM – to generate reference motions than to shape reward functions. Our hypothesis is motivated by the success of example-guided RL for humanoids, which exploits large-scale motion capture datasets as references for training locomotion policies. Unlike humanoids, quadrupeds lack such reference motion data. Towards this end, we propose MimicAgent, an agentic harness that, given a skill prompt, generates quadruped reference trajectories with coding agents. These coarse reference trajectories are then used to train example-guided RL policies that are deployable in simulation and in the real-world. Notably, we find that when prompting Claude Fable 5.1 within our agentic harness, 87% of prompts yield semantically aligned reference trajectories.

MimicAgent overview: Step 1 agentic trajectory generation from a text prompt, Step 2 example-guided reinforcement learning.
Overview. MimicAgent uses LLM coding agents within a recursive self-improvement loop to generate coarse reference trajectories (shown in green) from text prompts (Step 1). Our agentic pipeline converts short text prompts into detailed skill descriptions, translates these into executable functions that describe base and foot motion over time, and outputs them as reference trajectories. We show that these coarse motions are effective reference targets for example-guided RL (with policy rollouts shown in blue, Step 2).
MimicAgent pipeline: task description and robot model feed a motion planner, code generator, code executor and unit tests, with a motion diagnosis loop that revises the skill code.
MimicAgent pipeline. Given the prompt “the wheeled quadruped performs a full forward flip and lands upright on all four wheels”, our motion planner agent draws on prior knowledge of the robot model and the simulation environment API to decompose the skill into subparts. The code generator agent converts this phase plan into executable base and foot trajectories, which the kinematic executor renders. Task-agnostic unit tests then check the rendered motion for violations. The motion-diagnosis agent summarizes any failed checks and returns them as targeted feedback for code revision. This self-improvement loop repeats until the trajectory passes validation or the iteration budget is exhausted.

We compare MimicAgent against two state-of-the-art baselines (Eureka and Manual Keyframing) across seven skills: Trot, Bound, Side Flip, Front Flip, Aerial Crossover (AC), Crab Diagonal Scuttle (CDS), and Reverberating Yaw Pulse (RYP). Trot and Bound run on the Unitree Go2; the remaining five skills run on its wheeled-legged variant, Go2-W. Each video demonstrates the performance of different methods on the same skill.

Skill
Eureka
Keyframing
MimicAgent (Ours)
Trot A steady forward gait where diagonal leg pairs alternate in synchronized stance and swing phases while tracking commanded velocity.
Bound A dynamic gait where the front legs move together and the hind legs move together, producing powerful push-offs and brief aerial phases for fast forward motion.
Side Flip A lateral acrobatic maneuver where the robot jumps and performs a full rotation about its forward axis before landing stably.
Front Flip A forward somersault where the robot launches upward, rotates about its lateral axis, and lands back on its feet.
Aerial Crossover A dynamic maneuver where the robot leaps into the air and crosses its legs mid-flight before reestablishing stable ground contact.
Crab Diagonal Scuttle Diagonal locomotion with the body oriented perpendicular to the travel direction, scuttling sideways like a crab.
Reverberating Yaw Pulse In-place yaw rotation driven by damped oscillatory pulses that gradually settle.

User study (n = 57). Mean human preference rating (1–5, higher is better) for policies from human-annotated keyframes, Eureka, and MimicAgent. Bold marks the top-rated method for each skill. Users prefer MimicAgent for Trot, Side Flip, Front Flip, Aerial Crossover, and Crab Diagonal Scuttle; human keyframes for Bound (where all methods score low); and Eureka for Reverberating Yaw Pulse.

Robot Go2 Go2-W
Method ↓ / Skill → Trot Bound Side Flip Front Flip AC CDS RYP
Keyframe Tool 2.9 ± 1.4 3.5 ± 1.4 3.5 ± 1.2 4.2 ± 1.0 2.3 ± 1.3 2.5 ± 1.2 1.8 ± 1.2
Eureka 2.6 ± 1.5 2.8 ± 1.4 1.4 ± 1.1 1.1 ± 0.3 1.9 ± 1.1 2.1 ± 1.1 4.3 ± 1.4
MimicAgent 4.4 ± 1.0 3.2 ± 1.4 4.9 ± 0.3 4.6 ± 0.8 4.2 ± 1.0 4.5 ± 0.5 2.6 ± 1.4

MimicAgent learns and executes a wide range of locomotion skills directly from text descriptions. The green robot shows the reference trajectory generated by MimicAgent, and the blue robot shows the learned policy.

Preliminary results show that MimicAgent can be adapted for humanoid locomotion on the Unitree G1. Given the humanoid's model and configuration as context, the same prompt-to-trajectory framework generates diverse whole-body skills, from acrobatics to climbing and interaction with objects. Each clip shows the G1 reference motion (in green).

MimicAgent policies transfer from simulation to the physical robot. The clips below show several skills executed on real hardware, including dynamic side flips, back flips, and a four-leg to handstand spin transition.

We distill the trained teacher policy into a deployable student policy that runs from onboard observations alone. Below, all three tracks execute the same four-leg-to-handstand spin transition side by side, the student stays in near-lockstep with both the teacher and the reference, showing that distillation preserves this difficult, dynamic skill.

Four-leg to handstand spin transition. Left to right: the MimicAgent reference (green), the teacher policy (blue), and the distilled student policy (magenta), executing the skill in synchrony. The student reproduces the teacher's behavior using only the deployable observation space.

If you find our work useful, please cite:

@article{nayak2026mimicagent,
  title   = {MimicAgent: Quadruped Skills via Prompt-to-Trajectory Generation},
  author  = {Lucky Kant Nayak and Narayanan Palghat Parameswaran and Neehar Peri and Deva Ramanan},
  journal = {arXiv preprint arXiv:2609.24145},
  year    = {2026}
}