All Articles
All Articles




The SXSW Interactive installation that allows users to explore alien worlds through Kinect

by Graham Hiemstra
on 12 March 2014

While a good majority of panels and projects at this year's SXSW Interactive centered around the NSA and government surveillance, interactive installation StreamMeUp offered a lighthearted alternative to the discussion on where advancements in technology can lead us as a society. Created in collaboration between Microsoft Studio and an impressive team lead by artist and acting Technical Director James George—with art direction and design by Something Savage studio—the unbranded science fiction–inspired installation was a response to what was essentially an emerging technology-based art commission. With the help of four Kinects and a virtual reality headset, conference goers were given the opportunity to see a digital transmission of themselves on a series of far off planets. "It's like a Vine, for aliens," joked George.

StreamMeUp-upload.jpg StreamMeUp-5D.jpg

Four calibrated Canon 5D Mark III cameras paired with Kinect sensors would capture six seconds of action by the individual or group of participants. You then watch as your virtual self is teleported off the capture space ship screen. Next, you're physically led to a seated area where an Oculus Rift virtual reality headset allows you to visually explore three alien environments and interact with local lifeforms. The use of team members as guides helps lessen any intimidation created by the technology while also strengthening the narrative and storytelling. Monitors display a single view of what is displayed in the two-eyed Oculus, giving spectators a direct view at what each participant sees.

"The way we interact with images is changing. And I want that change to really ignite the imagination and enable people to be more creative." -James George

"This type of emerging technology—advanced virtual reality, 3D scanners—are inevitably becoming an everyday part of our experience in the same way that cellphone cameras have become part of our experience. There's a whole dialogue around surveillance and future camera technology that's very dystopian. And I think that's a really important conversation, but the way I like to contribute to that is through making things that are playful and fun and taking the conversation in a different direction," explains George of his inspiration and intention. "I know it as a fact that the way we interact with images is changing. And I want that change to really ignite the imagination and enable people to be more creative. So something like this is an opportunity to do that. If we focus on the negativity that will manifest itself—it's about imagining the future we want to be in.

StreamMeUp-in-action.jpg StreamMeUp-environments-sketch.jpg
"I want to be like a figure painter with code." -James George

"I'm all about mixing generative art and code with figurative work," says George. "I want to be like a figure painter with code. That's why a 3D scanner to me is really powerful, because it turns people into data that I can manipulate." By tweaking the code, George is able to create an abstract yet highly expressive representation of the human form. George achieved the effect by writing all the camera calibration and code in openFrameworks, which allowed him to take advantage of the new open source KinectCommonBridge library he helped develop while serving as the first artist-in-residence at Microsoft Research.


Something Savage studio used skyboxes to turn digitally painted panoramic landscapes into 3D worlds. On each world, a 3D character was created to add to the experience. These were animated by Patrick Clarke in Maya to compliment the low-res body scans and limited resolution of the Oculus Rift, helping to create a cohesive aesthetic throughout each world.

Though the StreamMeUp experience was temporary—running 7-9 March 2014 at SXSW Interactive—the GIFs produced can be seen online through Twitter and Microsoft Research.

Images courtesy of Something Savage

The CH25 is a showcase of creators and innovators from a broad range of disciplines who are currently working to drive the world forward.

Meredith Perry

How searching the Internet helped a 22-year-old invent wireless electricity

Read More
It’s not about where the information is, it’s about how you use the tools

Melissa Kushner

Addressing the needs of orphans and vulnerable children in Malawi through microenterprise

Read More
Poverty is complicated, there is an increasing temptation and pressure in the development space to oversimplify things

Roxie Darling

From un-shampoo to transgender identity, the NYC colorist boldly defining the next chapter of hair

Read More
Hair color is as much a science as it is a craft

Matt Kenyon

Fusing art and technology to disrupt concepts of corporate America

Read More
I want the work to live in the world and circulate, so it can generate more dialogue

Douglas Riboud + Justin Guilbert

How a mission to create great coconut water led to a whole new way of doing business

Read More
We’ve made a conscious decision to be as transparent and honest as we can, and let people decide for themselves

Alex Kalman

The tiny museum in Manhattan that’s redefining museums

Read More
The mission is to put this small simple and powerful tool into the hands of as many people as possible

Eelke Plasmeijer

The locally driven restaurant that’s upending Balinese food culture

Read More
We really try to keep things simple and let the produce do the talking

Tal Danino

The bioengineer who’s programming DNA to fight cancer

Read More
[Manipulating genes] is very new, people are just learning how to program these organisms

Sarah Kunst

The entrepreneur single-handedly changing the landscape for women in tech

Read More
People who live on a planet that is half women but can never seem to find any when they need one, I have solved your problem

Tarren Wolfe

The next-generation appliance making kitchens greener—literally

Read More
Our goal is to provide food for everyone in the world, and the best place to start is in our very own community

Sabine Seymour

A future where smart clothes are as ubiquitous as zippers

Read More
In the future you will not buy a piece of 'functional' clothing without SoftSpot

Lulu Mickelson

A civic leader bringing change to NYC through design

Read More
Human-centered design is one of the many tools that we can use to better engage the public

Leopoldine Huyghues Despointes

The young filmmaker and non-profit founder who just wants people to follow their dreams

Read More
I feel confident and ready to accomplish so much more, the movement is on

Marcus Weller

Using technology to turn motorcycle helmet design on its head

Read More
I was taken aback both by the number of people that doubted it, and by the equally large number of people that got behind it

Dan Barasch + James Ramsey

A quest to make the future brighter—underground

Read More
We both share a passion for groundbreaking technology and a shared love of New York

Corinne Joachim Sanon

The chocolatier bringing social change to Haiti and bean-to-bar chocolate to the world

Read More
Seeing the poverty surrounding me and the lack of jobs and opportunity bothered me

Cynthia Breazeal

How an emotional, empathetic robot named Jibo stands to revolutionize communication

Read More
The thing that's so provocative about social robots is that it's fundamentally a community technology

George Arriola and Monohm

An heirloom electronic for the post-smartphone era

Read More
We agonized during the design process as all hyper-obsessed craftspeople should

Pauline van Dongen

The Dutch designer blazing the wearable technology path

Read More
I’m fascinated by concepts of change, movement, energy and perception; since they are closely related to the way we experience the world

Vanessa Newman

Redesigning pregnancy for the post-gender generation with Butchbaby & Co.

Read More
I want my customers to feel comfortable and unchanged, in that becoming pregnant didn't take away from or compromise their identity

Kegan Schouwenburg

Revolutionizing orthotics through 3D-printed insoles

Read More
What orthotics do is they effectively change the geometry of what your alignment is like

Jonathan Sparks

Reinventing electronic music by inventing multi-disciplinary instruments

Read More
Recorded music is becoming so cheap, so the value of music is now in live performance

LaToya Ruby Frazier

Documenting the slow, troubling change in Braddock, Pennsylvania

Read More
I am not a journalist, I am a conceptual documentary artist using my visual expression for building narratives that are unseen and unheard

Joshua Harker

Pushing the boundaries of sculpture with intricate 3D printing

Read More
My intent was to explore and depict the architecture of the imagination, to interpret and share forms evident in the mind’s eye

Kathleen Supové

The NYC performance artist who’s radically reinventing the piano recital

Read More
I like pieces that are virtuosic, that show off the piano and what it can do, and are awe-inspiring
Loading More...