DevLog: Telekinesis — The Show in Show and Tell

DevLog: Telekinesis — The Show in Show and Tell

In this post showing how any remote can be used to teleoperate a robot. I call this Telekinesis and it powers the “show” of show and tell.

Ultimately, we will be using the onboard camera for zero-dependency teleoperation and setup. However, the demos below set the stage for remotely tele-operating any droid from anywhere.

You could:

  • do show and tell from anywhere
  • intervene from anywhere if your Droid gets stuck
  • use a service to intervene on your behalf
  • hire a global physical workforce that could work anywhere at all hours
  • bring your own remotes

We see many exciting potentials using Telekinesis for Droid Show and Tell.

VisionOS Prototype

IoS Prototype

Future

I’d like to complement this “Show” piece of Droid Show and Tell with the “Tell” piece soon. We don’t want Droid to act humanlike but we do want you to be able to talk to it and have it audibly talk back.