All Articles
All Articles
TECH

Interview: Neil Harbisson

How this man—a colorblind cyborg—is sharing his ability to "hear" colors with the rest of the world

by Nara Shin
on 05 May 2014
neil-harbisson-charged-3.jpg

While the term "wearable technology" might make you think of a fitness tracker or Dick Tracy-esque talking wristwatch, Barcelona-based artist Neil Harbisson wears an antenna that is permanently implanted in his head. Diagnosed with achromatopsia (complete color blindness) as a child, Harbisson had been searching for a way to experience color further than the greyscale he knew. The sensor at the end of his antenna reads wavelengths of light, or colors, and converts them into a sound frequency. Different colors translate into different pitches and Harbisson can even "see/hear" colors outside the visible spectrum, such as infrared and UV light. The sound's volume indicates how vivid the colors are.

The device, which Harbisson calls his "eyeborg," has become much more than just a tool to aid his visual impairment. It's transformed the way he interacts with the world—a trip to the supermarket can feel like a night club, with so many brightly colored fruits and vegetables. An outfit for the day is selected based on the major or minor chord he wishes to express. By enhancing his capacities as a human through this device, Harbisson self-identifies as a cyborg—and the UK government considers him one, too, allowing him to include his eyeborg in his passport photo.

Now, Harbisson's goal is to share this unique experience through his artwork and musical performances, which blend both visual and sonic elements. In "Colour Scores," Harbisson "converts" well-known songs, from Beethoven's "Für Elise" to Justin Bieber's "Baby," to the colors he visualizes. (John Cage's silent 4'33" is, unsurprisingly, all black and white.)

In 2010, he founded the Cyborg Foundation with his longtime collaborator and friend, choreographer Moon Ribas, to encourage others to explore this new realm of cybernetics in the arts. Harbisson's belief is that society shouldn't just be improving gadgets and making computers and mobile phones more powerful and faster, but writing apps for our own bodies to extend the senses. Imagine a day when one can have a dog's sense of smell, or a cheetah's hearing—and use them to create art. We spoke with Harbisson over Skype to learn more about his life as a cyborg activist.

neil-harbisson-charged-2.jpg
What does the weather sound like where you are? It's pretty rainy and gloomy here in New York.

Very loud today, because there's lots of bright colors—it's very sunny.

Your eyeborg has been updated multiple times since its 2003 inception. What is the current set-up and what are your future plans for updating it?

In front of my eyes, there's a color sensor that picks up the light frequency and it sends it to the back of my head. I have three holes in my head; one is for the audio entry and the other two are for the antenna. Now, I need to use a very small battery [changed every] 4 or 5 days; it depends if there's lots of colors or not. But the next stage is to charge it with my blood circulation so I don't need to depend on external energy; I can use my own body energy.

Can you tell us about your musical background?

I was trained as a pianist, so I studied piano and classical music, and then I went to England to study experimental composition [at Dartington College of Arts in England]. That's where this project started. This antenna is basically a musical instrument installed in my body. Experimental music.

Yet it's almost misleading to call you just a musician, or just a visual artist.

In my case, there's no difference between the visual world and the sonic world—they're the same. When I hear music, I perceive color, and when I have colors in front of me, I hear music. So it's in all the same field. If other people start experiencing or experimenting with other unions of senses, then it might happen that we'll start seeing new art forms.

neil-harbisson-charged-1.jpg
You also collaborate often with choreographer Moon Ribas. Can you explain how you two work together?

Moon has her own cybernetic extension. She can feel earthquakes through a sensor that she has attached on her elbow, so at her last performance, whenever she felt an earthquake, she started dancing. The sensor is connected to online seismographs [around the world], so wherever she is, she will feel an earthquake. So there's usually earthquakes every 10 minutes, or 8, or 12. It depends; she's constantly feeling them.

Depending on the intensity of the earthquake, the dance evolves. I was there putting sound and music to the information that I got from the earthquake, as well. I played the note equivalent to the frequency of the earthquake, and I also used the color light of the same frequency on stage.

You and Moon head the Cyborg Foundation. What are some of the projects the organization is overseeing?

There's another project that is about sensing what is behind you. In Barcelona, they are developing these four sensors that attach to the head, and then whenever someone gets close to you, it vibrates. It allows you to feel presence behind you or around you, without using your eyes.

neil-harbisson-charged-4.jpg
How about the activism part of the organization?

It's just defending basic rights; it's not creating new rights for cyborgs. We want to be sure that no one is discriminated because they decided to use technology as part of their body. [For example], even though I explain that my camera doesn't film, sometimes they don't allow me in [museums]. It's just trying to make people aware that cameras are not only used to film things; in my case, I'm using a camera for something completely different. I'm not interested in filming anything.

Has there been a time where you've been overwhelmed by hearing colors?

Well, just a moment ago! I was trying to connect to a telephone through my antenna. We were just testing this and I got a bit confused because I think I was receiving sounds from somewhere else, and then I was hearing colors, then having a phone call—it was a bit chaotic!

Update: Harbisson recently had British comedian Ruby Wax call his head and uploaded a video online.

Images courtesy of Moogfest

The CH25 is a showcase of creators and innovators from a broad range of disciplines who are currently working to drive the world forward.

Sarah Kunst

The entrepreneur single-handedly changing the landscape for women in tech

Read More
People who live on a planet that is half women but can never seem to find any when they need one, I have solved your problem

LaToya Ruby Frazier

Documenting the slow, troubling change in Braddock, Pennsylvania

Read More
I am not a journalist, I am a conceptual documentary artist using my visual expression for building narratives that are unseen and unheard

Matt Kenyon

Fusing art and technology to disrupt concepts of corporate America

Read More
I want the work to live in the world and circulate, so it can generate more dialogue

Pauline van Dongen

The Dutch designer blazing the wearable technology path

Read More
I’m fascinated by concepts of change, movement, energy and perception; since they are closely related to the way we experience the world

Sabine Seymour

A future where smart clothes are as ubiquitous as zippers

Read More
In the future you will not buy a piece of 'functional' clothing without SoftSpot

Meredith Perry

How searching the Internet helped a 22-year-old invent wireless electricity

Read More
It’s not about where the information is, it’s about how you use the tools

Melissa Kushner

Addressing the needs of orphans and vulnerable children in Malawi through microenterprise

Read More
Poverty is complicated, there is an increasing temptation and pressure in the development space to oversimplify things

Lulu Mickelson

A civic leader bringing change to NYC through design

Read More
Human-centered design is one of the many tools that we can use to better engage the public

Roxie Darling

From un-shampoo to transgender identity, the NYC colorist boldly defining the next chapter of hair

Read More
Hair color is as much a science as it is a craft

Dan Barasch + James Ramsey

A quest to make the future brighter—underground

Read More
We both share a passion for groundbreaking technology and a shared love of New York

Vanessa Newman

Redesigning pregnancy for the post-gender generation with Butchbaby & Co.

Read More
I want my customers to feel comfortable and unchanged, in that becoming pregnant didn't take away from or compromise their identity

Corinne Joachim Sanon

The chocolatier bringing social change to Haiti and bean-to-bar chocolate to the world

Read More
Seeing the poverty surrounding me and the lack of jobs and opportunity bothered me

Tal Danino

The bioengineer who’s programming DNA to fight cancer

Read More
[Manipulating genes] is very new, people are just learning how to program these organisms

Kathleen Supové

The NYC performance artist who’s radically reinventing the piano recital

Read More
I like pieces that are virtuosic, that show off the piano and what it can do, and are awe-inspiring

Jonathan Sparks

Reinventing electronic music by inventing multi-disciplinary instruments

Read More
Recorded music is becoming so cheap, so the value of music is now in live performance

Joshua Harker

Pushing the boundaries of sculpture with intricate 3D printing

Read More
My intent was to explore and depict the architecture of the imagination, to interpret and share forms evident in the mind’s eye

Eelke Plasmeijer

The locally driven restaurant that’s upending Balinese food culture

Read More
We really try to keep things simple and let the produce do the talking

Douglas Riboud + Justin Guilbert

How a mission to create great coconut water led to a whole new way of doing business

Read More
We’ve made a conscious decision to be as transparent and honest as we can, and let people decide for themselves

Marcus Weller

Using technology to turn motorcycle helmet design on its head

Read More
I was taken aback both by the number of people that doubted it, and by the equally large number of people that got behind it

Alex Kalman

The tiny museum in Manhattan that’s redefining museums

Read More
The mission is to put this small simple and powerful tool into the hands of as many people as possible

Tarren Wolfe

The next-generation appliance making kitchens greener—literally

Read More
Our goal is to provide food for everyone in the world, and the best place to start is in our very own community

George Arriola and Monohm

An heirloom electronic for the post-smartphone era

Read More
We agonized during the design process as all hyper-obsessed craftspeople should

Leopoldine Huyghues Despointes

The young filmmaker and non-profit founder who just wants people to follow their dreams

Read More
I feel confident and ready to accomplish so much more, the movement is on

Cynthia Breazeal

How an emotional, empathetic robot named Jibo stands to revolutionize communication

Read More
The thing that's so provocative about social robots is that it's fundamentally a community technology

Kegan Schouwenburg

Revolutionizing orthotics through 3D-printed insoles

Read More
What orthotics do is they effectively change the geometry of what your alignment is like
Loading More...