Manipulate Objects Directly in Video

Using a conventional camera and an algorithm, MIT manages to allow objects to be interacted with directly in video based on the tiniest vibrations, which are extrapolated.

With this technique, even the most inconspicuous movements of objects can be recorded. An algorithm calculates the “probable behaviour” in different movements. This allows the user to play with the object live in the video, pull at it and bend it.

More in the video.

Archive notice: This article was originally published on 2016-08-30. Links and embedded videos are preserved as part of the historical record.