Discussion about this post

User's avatar
Roy Xing's avatar

On the topic of IL/BC/VLAs dominating manipulation and locomotion. I might be wrong, but I was under the impression that despite recent advances these two application fields are still separate in their approaches? For example, I haven't seen any VLAs full control a whole loco-manipulation task, giving action chunks for both the arms and legs. Vice versa, the Omni-* related lines of works (OmniXtreme, OmniRetarget, similar works not named Omni-...) use IL/BC for locomotion and even gross loco-manipulation tasks, but haven't been able to cross over into fine-grained manipulation that VLAs dominate.

Maybe it's just cope on my end, but I think (or hope) that there's valuable research to be done in domains in which we don't have ample data (and might never will), such as control policies for non-humanoid morphologies. Perhaps, despite the hype on "one policy to control them all" there will be specialization in morphology control for applications? Maybe that's wishful thinking lol.

Looking forward to more of these articles!

No posts

Ready for more?