Welcome to the Real World – Kinect in Squeak

21 January, 2011

The newly-launched Microsoft Kinect has been causing a lot of excitement in hacker circles since its recent launch, due to its open interfaces, and the Smalltalk community has already got some great uses of this device.

The Kinect is a device, intended to be used as an accessory for the X-Box, which interprets 3D scene information from a continuously-projected infrared structured light, allowing live controller-less interaction by interpretation of movement and posture. This makes it a great complement to existing project teams working in Smalltalk.

Ricardo Moran was a member of the team from the Grupo de Investigación en Robótica Autónoma at CAETI in Argentina who won the 2010 ESUG Innovation Technology Awards with Physical Etoys, their Arduino-based interface to Squeak which allowed them to monitor and control robots as they drove round the conference hall. They spent their prize money wisely, buying a Kinect! Building on the work done by Stephen Howell in getting the Kinect working with Scratch (a visual programming environment developed at MIT), they have now shown how to use the Kinect to control activities in Etoys, using the existing OSCeleton framework to provide the skeleton interpretation interface. Their approach is documented in more detail on their blog.

Another approach to integrating data from the Kinect is that taken in Nikolay Suslov’s separate and equally impressive implementation which uses the lower-level OpenKinect driver to access the raw colour and depth information and pass this into his bespoke Krestianstvo images, where he then does the detailed video processing and interpretation in Smalltalk, which reduces his reliance on external, platform-specific code. His blog gives more details of his implementation as well as source code, and pre-built images.

2 Responses to “Welcome to the Real World – Kinect in Squeak”


  1. […] This post was mentioned on Twitter by Toru Inage, Michael Davies. Michael Davies said: Welcome to the Real World – Kinect in Squeak: http://wp.me/p1EJI-eE […]

  2. Johns Says:

    I love the fact that no protections being passed when using the Kinect with Open Source drivers. Without that I’m sure Microsoft would crush something thats truly amazing with the Kineect.

    Its not everyday that a mainstream product becomes popular with a subculture like the Kinect is. I really think though that the most popular aspect about the Kinect will be the commercial applications though. As seen through the Roomba team and its new robot powered by two Kinects.

    Onward and upwards and I hope the OpenKinect community keeps driving this forward!


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: