“wired”
4 posts under this tag.
Sunny Bains’s Mixed Feelings is a cool article in last month’s Wired about synthetic synesthesias: using technology to give us new senses by using old ones’ bandwidth. Stuff like using the tongue to see, or, below, using touch to locate.
For six weird weeks in the fall of 2004, Udo Wächter had an unerring sense of direction. Every morning after he got out of the shower, Wächter, a sysadmin at the University of Osnabrück in Germany, put on a wide beige belt lined with 13 vibrating pads — the same weight-and-gear modules that make a cell phone judder. On the outside of the belt were a power supply and a sensor that detected Earth’s magnetic field. Whichever buzzer was pointing north would go off. Constantly.
The brain, it turns out, is dramatically more flexible than anyone previously thought, as if we had unused sensory ports just waiting for the right plug-ins. Now it’s time to build them.
“It was slightly strange at first,” Wächter says, “though on the bike, it was great.” He started to become more aware of the peregrinations he had to make while trying to reach a destination. “I finally understood just how much roads actually wind,” he says. He learned to deal with the stares he got in the library, his belt humming like a distant chain saw. Deep into the experiment, Wächter says, ”I suddenly realized that my perception had shifted. I had some kind of internal map of the city in my head. I could always find my way home. Eventually, I felt I couldn’t get lost, even in a completely new place1.”
Some intriguing stories here about the brain that will delight anyone who has read Jeff Hawkin’s mind-bendingly good On IntelligenceAM. Another example:
 More than 50 years ago, Austrian researcher Ivo Kohler gave people goggles that severely distorted their vision: The lenses turned the world upside down. After several weeks, subjects adjusted — their vision was still tweaked, but their brains were processing the images so they’d appear normal. In fact, when people took the glasses off at the end of the trial, everything seemed to move and distort in the opposite way.
Of course any true Jeff fan would nod knowingly and immediately quote back with:
Patterns are all the brain knows about. Brains are pattern machines. It’s not incorrect to express the brain’s functions in terms of hearing or vision, but at the most fundamental level, patterns are the name of the game. No matter how different the activities of various cortical areas may seem from each other, the same basic cortical algorithm is at work. The cortex doesn’t care if the patterns originated in vision, hearing, or another sense. It doesn’t care if its inputs are from a single sensory organ or from four. Nor would it care if you happened to perceive the world with sonar, radar, or magnetic fields, or if you had tentacles rather than hands, or even if you lived in a world of four dimensions rather than three.
Jeff Hawkins, On IntelligenceAM, p2
Being a fan of the concept since my soundscape post, however, I was surprised the article doesn’t mention the inspiration for my post and the most widespread example yet of a synthetic synesthesia: the beeping proximity sensor in many vehicles—space as sound. My brain has become so used to it that at times glancing back seems like a distraction.
This was originally appended to the original lonelygirl article some weeks ago. I’m moving it to the blog stripELZR itself because I doubt anyone noticed it.
It’s frighteningly fast how the avant-garde becomes the status quo. Not long ago Google was an underdog. It is now unarguably a behemoth. (“Google is the weather.”EEM) Two months ago it payed 1.65 billion for YouTube, the new media underdog. Now lonelygirl15, YouTube’s first star, has made the cover of this month’s Wired. And her article, The Secret World of Lonelygirl, is a fascinating behind-the-scenes look at how it all started. From Jessica Rose’s misgivings about the shady project, to her browseresque beauty, to lonelygirl’s origin as the alter ego of a commune-raised, bullied boy.
Jessica Rose was suspicious and frankly a little pissed off. She had come to this organic-tea shop to discuss what she thought was a feature film called Children of Anchor Cove. Now Beckett and Flinders had made her sign a nondisclosure agreement and, clearly pleased with themselves, told her that they wanted her to play the lead in what they billed as the future of entertainment. For free. It was an Internet-something-or-other –- she wasn’t listening. They were also going to “hire” another actor to play a character named Daniel. It sounded a lot like porn.
It was exactly what her acting coaches at Universal Studios’ film program had warned her against: unkempt producer-types hawking shady deals.
When he got to college, Flinders [cocreator of lonelygirl] dreamed up an alter ego—an awkward, geeky homeschooled girl. As a camp counselor, he told fireside tales about her experiences. He wrote short stories about her, and when he tried to make it as a writer in Hollywood, he put her in his screenplays.
There’s something about Jessica Rose that the webcam loves. Her distractingly large eyebrows and small round face are bent and stretched by the fish-eye lens into a morsel of beauty that fits perfectly in a pop-up window. That’s not to say she isn’t pretty off camera—she is—but every step she takes closer to the cam multiplies and enhances her looks. It’s a face made for the browser screen.
[Miles] Beckett was at home trying to decompress. He had been working as an urgent care doctor to pay the rent and was exhausted. Between filming and editing the Lonelygirl15 series and dealing with severed fingers and dog bites at the hospital, he wasn’t sleeping much. It didn’t help that Goodfried called at 2 am.
”Miles, it’s time you quit being a doctor,” he said. “We just passed 200,000 views.”
Within 48 hours, the video had half a million views. Goodfried knew that to be considered a success, a cable television show needs to get between 300,000 and 500,000 viewers. “My Parents Suck …” had vaulted into that territory.
Each episode needs to be short, no more than three minutes. ”You wouldn’t show a sitcom at a movie theater, right?” Beckett says. “You make movies for the big screen, sitcoms for TV, and something else entirely for the Internet. That’s the lesson of Lonelygirl15.”
This Web series not only looks different, it’s made differently than other filmed entertainment. As Bree’s universe expands, each new character will have his or her own vlog. Flinders can’t write and film them all, so new writer-directors have been hired and paired with actors playing the new characters. Unlike television, where writers sit in a room and come up with a single script, the Lonelygirl15 team comes up with a general plotline and then sends its writer-directors out to produce independent but interconnected videos. All the characters, in essence, have their own show.
Rose leaps onto the bed and jumps up and down. She makes faces at the camera and waves her hands, knocking askew the picture of the rose hanging on the wall. Beckett got it at a 99-cent store because it was cheap and looked like something a teenage girl would buy. Nobody seems to have noticed the faint pink quotation printed beneath the flower: ”It is by believing in roses that one brings them to bloom.” 
When they arrived in his office and Abir explained the concept for what is now called the decoder, Carbonell was floored by its elegance. “In the few weeks that followed, I kept wondering, ‘Why didn’t I think of that? Why didn’t the rest of the field think of that?’ Finally I said, Enough of this envy. If I can’t beat them, join them.”
I’m floored too. (And envious!) What Meaningful Machines lyrically calls «flooding» in a recent Wired article, Me Translate Pretty One Day, is a stunningly beautiful translation algorithm, baffling in its simplicity.
Though if it’s simple to state and understand, it’s only because it relies on operations on a terrifying (computational, mathematical) scale. (Like the first time one invokes inside a theorem, say, the set of all possible sets, there’s a mixture of fright and awe—we can barely believe our moxie to write such thoughts.) In a very real way, the algorithm is written in Moore’s law language and if it escaped us all it’s mostly because our words are so shy, so inadvertently constrained by past assumptions.
Ah! How exciting! Machine language translation is on the horizon.
In which the soundscape is presented and used as an introduction to other synthetic synesthesias.
A few months ago my family got a new van, a Windstar. It’s a pretty good car and, being a luxe edition, has many interesting gizmos. My favorite one is a sensor that starts screeching when you get too close to something in the back.
It is not its human-augmentation side what fascinates me the most, but the possibilities that such a sensor suggests. Why not go crazy and make this a gizmo that truly represents space, in all its subtleties, through sound?
I envision a somewhat thick, solid, black band that you would close around your head, completely covering your eyes and your ears; somewhat like a headband worn too low.
This gadget, the soundscape (scape for short), will simply translate space into sound. Let’s imagine the simplest case. A soundscaper standing in the center of a medium-sized, empty, white, circular room. What would that sound like? Well, as the soundscaper turns, it’d probably be a soft hum in all directions; medium-volumed to represent a medium distance; high-pitched to represent the whiteness of the walls; equal in all directions to parallel the physical reality.
If we increase the diameter of this circular room, the walls move farther away, and thus the (sound) volume will decrease; if we decrease the diameter, the walls come closer and the volume increases. If this room now had a door and it were open, the soundscaper would notice it as it turns around to “hear” the room: it would be a sudden sharp decrease in the volume.
If we now put a black square somewhere in the room close to the soundscaper, it’d sound like a squared speaker the size of the black square, emitting a somewhat loud, low-pitched noise.
Can you imagine it? Yeah, who knows if it would have a practical use (assist the blind?) and it’d probably never be advanced enough to allow you to, say, “read” a book through pure sound, but it sure’d be interesting to use it.
Of course, there’s no reason to stop at sound, maybe space can be represented through smell too (and maybe, just maybe, through taste). We always think of space as something fundamentally visual but that’s only because we’re all so visually biased. There are other possibilities.
And yet, sight is probably the best way to represent space. It’s by far the sense with the biggest bandwith. So much, in fact, that I think at least two other senses (hearing and smelling) can be merged into it. Thanks to sci-fi movies we’re all familiar now with some sort of thermal vision—in which red represents hotness, blue coldness. Hearing and smelling could be added in a similar fashion. Sound could be represented as an overlay of 3d waves expanding rapidly through space. The sound of birds chirping outside would look like a pond under a light rain, only in 3d. And smell could be represented as an overlay of little colored dots. A nubile girl passing by would leave a rainbow cloud of dots behind her.
But the soundscape still sounds the most daring, maybe because the possibility of replacing sight is as frightening as it is exciting. Just imagine, sound as light!
Update August 24, 2006: ABC News’ Humans With Amazing Senses: Blind People Who Interact With the World Like Dolphins and Bats
Update April 24, 2007: Wired’s Mixed Feelings: See with your tongue. Navigate with your skin. Fly by the seat of your pants (literally). I blogged about it here.
|
RSS
email
