A Helping Hand in Communication
The future of communication for the hearing and vision impaired

A day in the life of John
John is
A student
Shares a house with two friends
Enjoys shopping
Keeps in touch with friends and family
Totally Blind

Colours
Inexpensive
Accurate (enough)
Long battery life
Compact

Currency Identifier
Australian Polymer notes are of a similar size
Hard to distinguish denomination if totally blind
Utilises the unique pattern in the clear window

A Secure Dual Channel Wireless Headset for Multi-user Environments
Dual channel, two-way, high quality, low power infrared headset prototype which has been field tested by the ABWA and certified.

Current Form      Ideal Form
Braille
Not a direct correlation to text
Similar to shorthand
Consists of 6 dots that may be embossed on both sides

Curtin University Brailler (CUB)
Perkins Brailler
Mechanical only
Mountbatten Brailler
Electronic, very old technology

Slide 9
Curtin University Brailler
Braille Scanner
Aimed at Sighted non-Braille Readers
Converts Braille to Expanded Text in real time

Slide 12
Cisco Network Academy Program
The Networking Academy program is an e-learning model that delivers Web-based educational content, online testing, student performance tracking, and instructor training and support, as well as hands-on labs. (Cisco,2002)

Cisco Network Academy Program (CNAP)
10,312 Academies
1229 in Asia-Pacific
162 Countries
25 Countries in Asia Pacific
97,488 students in Asia Pacific
(as of 23rd April 2006)

Classmates
Cisco Network Academy Program
Current Access Methods
For low vision users.
Screen enlargement.
Zoomtext, Magic.
Screen review programs.
Jaws, Slimware, Artic.
Two output methods - speech and Braille displays.
Screen review software must rely on text output.
Tactile Graphics
PIAF
Printed Braille and Audio recordings

Network Dominoes
Tactile Printing
Whiteboard
Cheap camera
<$150
Portable
Multiple use of laptop

iNetSim
Simulates a network
Allows for trials of configurations without expensive equipment
Works with voice output

What about JohnÕs Text Books?
Daisy Digital Talking Book (DTB) compatible
Full Indexing
Annotations
Text
Audio
Video
High speed capture
90 minutes in 4 minutes
DRM enabled

What about Tony?
Sign Language
Common for hearing impairment
Uses Vision to replace sound
Many types
Auslan
ASL
BSL
But what if you donÕt
have vision either?

Slide 25
"A Demonstration"
A Demonstration

Some Obvious ChallengesÉ
Need an interpreter
Need a fluent interpreter
Slow to start with

É and some not obvious ones
One-to-one
In-person
Slang / Dialects

An Alternative
Slide 30
Slide 31
Slide 32
Slide 33
Removes Barriers
Communicate with non-signers
Through their choice of interface
Direct interaction, without an interpreter
Can talk to people in other rooms / cities / countries
Multiple people at once
Recording

The Hand is A Complex System
The Current Hand
All good
The challenges aheadÉ
Servomotors instead of air muscles
Artificial Intelligence to learn trajectories for the hand signs
Learn by mimicking

More challenges
Communication protocol
Correct data vs On-Time data
Social / Cultural Implications
ÒSMSÓ speak?

The Team
(in no particular order)
Staff
Chris Moore
Serge Mokroous
Kieren Eaton
Leigh Harrison
Students
Andrew Pasquale, Simon Dunn, Ryan Williams, Carl Blair, James Hope, Leong Chen Chew, Ben Farrugia, Ivar Siewert, Peter Scarfe

Thank You