yay-robot.github.io - Yell At Your Robot 🗣️ Improving On-the-Fly from Language Corrections

home > domains > yay-robot.github.io

Description: Yell At Your Robot 🗣️ Improving On-the-Fly from Language Corrections

language (2109) robot learning (26)

Example domain paragraphs

Yell At Your Robot (YAY Robot) leverages verbal corrections to improve robot performance on complex long-horizon tasks like packing a ziploc bag, preparing trail-mix, and cleaning dishes. It can incorporate language corrections in real-time and for continuous improvement .

🔈 try sound on!

Hierarchical policies that combine language and low-level control have been shown to perform impressively long-horizon robotic tasks, by leveraging either zero-shot high-level planners like pretrained language and vision-language models (LLMs/VLMs) or models trained on annotated robotic demonstrations. However, for complex and dexterous skills, attaining high success rates on long-horizon tasks still represents a major challenge -- the longer the task is, the more likely it is that some stage will fail. Can

Links to yay-robot.github.io (3)

• lucys0.github.io About | Lucy X. Shi
• huzheyuan.io Zheyuan Hu
• dit-policy.github.io DiT-Policy