Lucky Kant Nayak

M.S. Robotics · Carnegie Mellon University

I’m interested in scaling robot data and designing efficient frameworks and algorithms for robot learning.

I’m a Master of Science in Robotics student at CMU’s Robotics Institute, working with Prof. Deva Ramanan on robot learning. My recent work, MimicAgent, turns natural-language prompts into reference motions for dynamic quadruped skills.

Previously, I was a research assistant in RISLab with Dr. Wennie Tabib and a research intern in the STOCH Lab at IISc Bangalore with Dr. Shishir N. Y. Kolathaya. I hold B.Tech and M.Tech degrees in Aerospace Engineering from IIT Kanpur, where I worked on multi-UAV mapping with Dr. Indranil Saha.

Lucky Kant Nayak
Robotics Institute · Pittsburgh, PA

Research & selected work

Projects

Robot learning, human-centered autonomy, and 3D vision.

Human-robot interaction · Report

VIP: VLM-Guided Interactive Policy Steering

Test-Time Preference Alignment

A vision-language model compares candidate robot trajectories against a person’s preferences and asks a visually grounded question when uncertain. In the report, natural-language feedback improves alignment with fewer interruptions than manual trajectory selection, while conversation history reduces repeated questions.

With Shikun Ban, Shohei Nagai, and Zixi Song.

3D vision · Course project

Geometry-Aware Multi-View Diffusion

Enhancing Multi-View Diffusion with Geometry-Aware Positional Encoding

We add RayRoPE to EscherNet’s diffusion model for novel-view generation. The geometry-aware encoding improves image quality over camera-only encoding on DL3DV. We also study whether learned uncertainty tracks generation error, view visibility, and depth error.

With Minsik Jeon and Chaneui Song.

Legged robotics · IISc Bangalore

Quadruped Locomotion Control

Developed a hierarchical reinforcement learning controller for quadruped locomotion across slopes and varied surfaces. Contributed to a ROS 2 controller stack designed to work across robots and controllers.

Quadruped walking on a slope Quadruped walking on a ramp Quadruped locomotion experiment
Aerial robotics · IIT Kanpur

Aerial Mapping with Multi-UAV Systems

Developed multi-UAV coverage path planning for large-area mapping and adapted a mesh-optimization image-stitching method to produce natural-looking maps with low shape distortion.

Aerial mapping coverage plan Stitched aerial map