Fei Xia is one of three corresponding authors

43 authors in total

typical work: arm farm, sim2real transfer

复杂、非结构化环境，非结构化指令

现有机器人没办法理解自然语言指令

现有的机器人算法user interface很不友好，language is better

turn language into an implicit representation as one of inputs

language conditioning可以通过IL实现简单的“抓取可乐罐”的任务，但是“把可乐罐给我拿过来”就会fail，连第一步的抓都学不会

PaLM可以理解“幽默”，few-shot learning能在5-shot超过平均人类

next：how to apply LLMs to robotic tasks