Joystick Vocal

Quelle idée géniale !

20071008_pid37135_aid37134_vocaljoystick_w400

The Internet offers wide appeal to people with disabilities. But many of those same people find it frustrating or impossible to use a handheld mouse. Software developed at the University of Washington provides an alternative using the oldest and most versatile mode of communication: the human voice.

Vocal Joystick detects sounds 100 times a second and instantaneously turns that sound into movement on the screen. Different vowel sounds dictate the direction: « ah, » « ee, » « aw » and « oo » and other sounds move the cursor one of eight directions. Users can transition smoothly from one vowel to another, and louder sounds make the cursor move faster. The sounds « k » and « ch » simulate clicking and releasing the mouse buttons.

A lot of people ask: ‘Why don’t you just use speech recognition?’ Bilmes said. It would be very slow to move a cursor using discrete commands like ‘move right’ or ‘go faster.’ The voice, however, is able to do continuous commands quickly and easily.

Generating ‘oohs’ and ‘aahs’: Vocal Joystick uses voice to surf the Web | UW Today