Posts Tagged with 'voiceover'

iPhone + AppleTV = Low Cost CCTV Magnifier

An iPhoneThanks to Clytie for bringing to my attention a great article by Paul Biba on Teleread.com. Paul describes using the iPhone's AirPlay feature with an AppleTV hooked up to a 50 inch screen to display the iPhone screen in extreme magnification.

iPhone screen displayed on 50 inch TV monitor

iPhone displayed on a 50 inch TV, note cat in bottom left of picture for size reference

CCTV Magnification devices for low vision users typically cost a huge amount of money, so this combination could be a huge money saver for the visually impaired. Especially for those already owning an iPhone and/or AppleTV the additional cost could be minimal. I don't have a TV here so I can't try this out myself but I imagine this AirPlay monitoring could also be used with the camera applications to magnify physical objects. Can somebody report back about whether this works?

I also can't find any information about how the iPhone's three-finger-double-tap zooming works with AirPlay - will this zoom the image shown on the large TV? That'd be a huge additional help! [Edit: When I tested this using Reflection on my Mac it seemed to work which is very promising.]

To turn on AirPlay monitoring when you aren't in a video application simply double-click the home button on your iPhone, then swipe to the left twice. You should see the volume control and if AirPlay is connected there will also be a button there to turn the mirroring on.

- Ricky Buchanan

AppleVis Provides Resources for Blind Apple Users

AppleVis: For vision impaired iOS usersAppleVis is a website by and for blind and vision-impaired users of Apple devices, primarily iOS device users but including some resources for Mac OS X users. The focus is on VoiceOver users but there are some resources for other blind users who use zooming to access devices too.

A community-powered website for blind and vision-impaired users of Apple devices.

  • Seek and share information on the accessibility of apps developed for the iPhone, iPad, iPod Touch and the Mac.
  • Read and share guides, tutorials and tips to help VoiceOver users get the most from their Apple devices.

AppleVis is a site which provides many resources, including:

  • Directories of iOS and Mac applications with community-provided descriptions and thorough VoiceOver compatibility information for each program. Applications recommended as highly usable by blind users are also collected together in "Recommended App" lists.
  • A forum for discussing issues related to accessibility for Apple users.
  • AppleVis blog which highlights news of special interest and editor opinions.
  • Podcasts with walk-through style tutorials and reviews.
  • Guides section offers text tutorials
  • Reviews of accessibilities

Lots of stuff! Most is fairly high quality too, the moderators must work overtime there. This site is highly recommended for those interested in resources for vision-impaired Apple users.

- Ricky Buchanan

Speech-to-Text: Dictation software for Mac OS X

A microphone

Speech-to-text software, sometimes known as dictation software, is something that lets you talk to the computer in some form and have the computer react appropriately to what you are saying. This is totally different to text-to-speech software, which is software can read out text already in the computer.

Command and Control Software

There are two types of speech-to-text software available. One type is called "command and control" and it lets you speak commands to your computer to control it; hence the name. For example, a command that the computer understands might be, "go to the Apple website" or, "tell me the time". Each command is pre-programmed and the computer will only recognise those commands it's been programmed for; you can't use this software to write an email or use iChat for example.

Command and control software for the Mac - known as "Speakable Items" (or sometimes, confusingly, "spoken commands") - is already built into every OS X computer, although most people don't know about it. You don't need to download, buy, or install anything to get this software to work, just a microphone that works with your computer. The main drawback is that the Speakable Items software programmed for English with a standard American accent, and has significant trouble with any other accent. It doesn't function at all with languages other than English.

Some resources for getting you up and running with Speakable Items include:

Dictation Software

The other type of speech-to-text software is usually called "dictation" software. This is the type that lets you write an article like this one, type stuff to your friends in iChat, or type an email. The most common Windows software for speech to text dictation - you've probably heard of it - is Dragon NaturallySpeaking. There is only one dictation-capable speech-to-text software available for OS X which is being updated and developed and it's [msd]. Dictate is the successor to a program named iListen which MacSpeech used to produce.

MacSpeech Dictate iconLike all dictation-capable text-to-speech products, MacSpeech Dictate works very well for some people and very badly for others. Whether it will work for you depends on many things including: how much effort you're willing to put into learning it, how good your microphone is, your age (text to speech usually works less well for children), how much your accent matches what the program expects, and whether your voice changes a lot through the day.

MacSpeech Dictate is also still fairly new software - it was only released on the 15th of February, 2008. In comparison, the premiere speech recognition program for Windows is Dragon NaturallySpeaking which has been in development since the 1980s[1].

When MacSpeech Dictate was originally released it had several major problems which made it unusable for people with disabilities, but most of these have now been resolved:

  • There was no good help functions inside the application - this was rectified in Dictate version 1.3
  • It didn't learn from corrections - this was rectified in Dictate version 1.2
  • Couldn't spell words out by voice - this was rectified in Dictate version 1.2
  • Couldn't request individual key presses (such as command-s or command-option-escape) by voice - this was rectified in Dictate version 1.3
  • Couldn't be taught new words, such as names or jargon specific to your profession - this was largely rectified in Dictate version 1.2, although some words still resist training
  • There was no way to control the mouse by voice - this was finally rectified in Dictate version 2.0.

I tried using the old iListen program a few years ago and could not get results that were useful, an on-screen keyboard was the best solution at the time. Although MacSpeech Dictate is in its early days as a program, its recognition of my particular voice is hugely better than iListen's was. This is not surprising though, as MacSpeech Dictate's speech recognition engine is based on the same engine used by Windows' Dragon NaturallySpeaking - widely recognised as the best consumer speech recognition available.

[msd] requires the requires Intel-based Macintosh hardware and requires Mac OS X 10.5.6 (Leopard) and higher. Thirteen English dialects/accents are supported, and US and UK spelling options. These are:

  • US Spelling
    • American
    • American - Inland Northern
    • American - Southern
    • American - Teens
    • Australian
    • British
    • Indian
    • Latino
    • Southeast Asian
  • UK Spelling
    • Australian

    • British

    • Indian

    • Southeast Asian

Specialised versions - Dictate Medical and Dictate Legal - are available for dictating in these language areas, and Dictate International is now available and recognises speech in French, German, and Italian. MacSpeech have strongly hinted that Spanish language recognition is next on their agenda.

MacSpeech Dictate is a great program for dictation and some computer control, but it is not something that will let you control the computer completely "hands free". For quadriplegic users and others who need full computer control, you will need to supplement Dictate with use of a mouth stick and keyboard, or a program such as SwitchXS for switch access to functions not available by voice. I highly recommend Dictate though, it's part of my suite of accessibility technology and I use it whenever I am able to.

Website: [msd]

- Ricky Buchanan

[msddisclaim]

[msdbanner]

Back To The Accessible Mac: Accessibility Implications From Apple's 20 October Event'

Apple logo in reflective blackThere was a special Apple event in Cupertino on the 20th of October entitled "Back To The Mac". We were treated to a plethora of Mac-related announcements which have plenty of fantastic accessibility implications. I'm going to briefly run down what each announcement was, and why it matters for Mac accessibility.

State Of The Mac

Firstly Apple's Chief Operating Officer (COO) Tim Cook told us how the Mac was faring as a platform and the news is very good. There are more Mac users and Mac developers than ever before, and Apple is making plenty of money off all of us. The full information is available in MacLife's article: State of the Mac: "The Momentum Has Never Been More".

Why does this matter for accessibility: Firstly, there's no danger that Macs and OS X will be going away which is of course good! The iDevices and iOS are great but they don't do everything that everybody needs and it wouldn't be good if OS X disappeared at this point.

The fact that Apple as a company is making plenty of profit, despite the world economy, is good news for accessibility because unfortunately accessibility progress is often one of those not-very-visible things which tends to be cut back if a company hurting. This is obviously not something that Apple users need to be worrying about just now!

Steve Jobs discussed the new iPhoto included in iLife '11

Steve Jobs discussed the new iPhoto included in iLife 11

iLife '11

The newest edition of the iLife suite (including iTunes, iPhoto, iMovie, iDVD and GarageBand) will be iLife '11, and is available immediately. Improvements to the iLife suite include full screen modes for iPhoto, more ways to create iPhoto slideshows, audio filters and a 'movie trailer' mode for iMovie. GarageBand will sport some timing "fixer" technology knows as GrooveMatching and Flex Time, as well as new amplifiers and instrument lessons for aspiring piano and guitar players.

iLife 11 runs on three adjacent MacBooks

All of the iLife programs will be significantly updated.

It wasn't announced on the day of the event, but Maccessibility reports that iLife '11 also sports significant accessibility improvements, especially accessibility improvements in GarageBand. They don't cite their sources but Maccessibility are known for generally being accurate.

iLife '11 requires that you use the Snow Leopard operating system, and is available now for US$49 for an individual installation and US$79 for a family pack.

FaceTime Now Available For Mac

FaceTime, the video phoning application available on the iPhone 4 and newest iPod Touch, is now available for the Mac computer also. The downloadable version is still in beta so it may have a few problems, but it has been reported by members of the MacVoiceover list to be fully accessible to VoiceOver users.

Because FaceTime can be used to call people via a regular mobile phone number as well as via an email address, and is available on the very portable iPhone 4, it has been eagerly used by the Deaf community for video phoning. Having the service available on the Mac will be a huge bonus to Deaf users who don't have access to an iPhone 4 but know people who do, as well as to others who have family and friends with iPhone 4 or the new iPod Touch which also uses FaceTime.

FaceTime is free for Mac users and you can download it right now!

OS X 10.7 Lion Preview

After OS X 10.6 Snow Leopard will be OS X 10.7 Lion, expected to be available in mid 2011.

Lion will import some of iOS's good features back into OS X, including more multitouch gestures, a new Mac App Store, app home screens, full-screen apps with no menu bar at the top, auto save and apps that resume where they left off when relaunched.

OS X Lion will have many features imported from the iOS devices.

OS X Lion will have many features imported from the iOS devices.

Some of these things have accessibility potential for those with neurological impairment: things like auto-save and resuming where you left off when you launch an app make memory problems less of a problem. The simplicity of getting apps via a Mac App Store which takes care of downloading and installing for you means there's one less infrequently-done task to learn and remember, a bonus for those new to the Mac as well as an accessibility boon.

Multi-touch gestures that match those used on the iPad, iPod Touch, and iPhone will be great for some users - I use the mouse extensively myself and find gestures are fantastic. Unfortunately these require a high level of fine motor control in multiple fingers, so multi-touch is generally not very accessible to several groups including those who must use a stylus or a mouth stick, and are completely out for those who can't use a trackpad but need an alternative pointing device such as a joystick or trackball. Hopefully all multi-touch gestures will be implemented with keyboard equivalents so that users aren't left out in the cold.

The Mac App Store could also make it easier to spread the news about accessible apps and apps to aid accessibility, as has happened with the existing App Store. This would undoubtedly be a good thing, but I am concerned that app developers may be the losers in this new scenario - several things about the iOS App Store are very difficult for developers to manage and I wouldn't like to see developers give up on their accessibility apps for the OS X platform because of App Store issues. Hopefully this will not be an issue, but it does concern me. We won't have to wait long to find out: The Mac App Store will be launching for Snow Leopard within 90 days!

Also new to OS X Lion will be Launch Pad: a new way to launch apps from your desktop, similar to how it's already done on the iPad. This means that users can keep commonly used apps right in front of them without cluttering up the dock - another win for easy usability which also helps those with neurological issues.

A final new feature called Mission Control was also described but I can't tell you how easy it is to use because I didn't understand it! It has elements of Spaces, Expos and the Dashboard all mixed together, and I hope it's useful.

New MacBook Air Models

Two new Macbook Air laptops were announced, one 13.3 inch model and one 11.6 inch model. These don't have touch screens but were described by Steve Jobs as what happens when "an iPod hooks up with a MacBook"!

The 13 inch model is a tiny 2.9 pounds, and it shares many great features with the iPad: the ability to instantly start up, offering great battery life (7 hours of use has been quoted), amazing standby time, solid state storage with no optical or hard drives, and it's thinner and lighter than ever. The 11.6 inch model is pretty much the same, but with more of the "smaller and lighter" at only 2.5 pounds, and with a bit less battery life because there's less battery fitting in there.

Side on image of MacBook Air 11 inch held in a hand

The 11.6 inch MacBook Air is almost unbelievably small

For those who find the iPad is not accessible due to their disabilities, or those who just don't like typing on an iPad, these new laptops look to be a fantastic option. With instant start-up they will be great for taking notes in class, for use as communication devices, and other situations where waiting a few minutes for your laptop to boot just isn't sensible.

Having only solid state storage ("flash memory" like your iPhone, iPad, or camera has) and no hard drive or CD/DVD drive means the laptops are small and light but also that they have very few moving parts except the keyboard itself - Apple hasn't said so but I strongly suspect they will be more robust because of this. We've seen how much an iPod Touch or iPad can survive being dropped or otherwise battered around in daily use - imagine a laptop that would probably be OK if knocked off a desk or wheelchair tray! And of course smaller and lighter laptops mean less mounting equipment is needed for those with special positioning requirements.

I think that these new laptops will be "the iPad for switch users", and others who need non-standard input devices that the iPads don't cope with yet. I still hope, of course, that the iPad will grow into coping with a wider variety of input devices but these new MacBook Air devices are a "mid point" between the regular MacBooks and the iPads in terms of size and weight. You can get a glimpse of it in MacLife's First Look at the 11.6" MacBook Air article.

The 11.6-inch MacBook Air starts at US$999 with 64GB (US$1199 for 128GB) while the 13.3-inch model starts at US$1299 with 128GB and is also available with 256GB for US$1599. Both models are shipping now.

And so...

All in all, these announcements are a huge win for accessibility for Macs and Mac users in multiple ways. I am thrilled to see that Apple's commitment to accessibility continues unabated, and that their passion for Universal Design rubs off in the direction of accessibility so very often.

Which announcement are you most excited about? I really really wish I could get myself one of those teeny tiny laptops, but in the absence of a spare thousand dollars I'm most excited about OS X 10.7 Lion and the new iLife '11. Those are things I can actually use, and use soon.

Here's to the future!

- Ricky Buchanan

PR images courtesy of Apple. Screenshots by me.

Stories: iPad Users With Disabilities

An iPadThere have been a plethora of stories in the mainstream news and in blogs about the iPad and the amazing positive effects it's having for people with various disabilities. Children with autism are the subject of many of these stories, but there are plenty of others who are getting amazing results from their iPads too.

I haven't been able to keep up with all the stories, but here's a round-up of some of them. If you know of more, please leave a comment at the bottom of this post:

The Wall Street Journal itself has written about the iPad for people with disabilities: Using the iPad to Connect: Parents, Therapists Use Apple Tablet to Communicate With Special Needs Kids is a great article and includes quotes from Steve Jobs and also a video showing some use of the iPad:

Making weird cool - Robert Rummel-Hudson talks about why he thinks the iPad is a game-changer for AAC and why it's important to have devices that don't say "I have a disability!" as soon as you walk into a room with one.

Zach's A Mac - Zach is a 3 1/2 year old boy with cerebral palsy who's learning to use an iPad.

I use my iPad while wearing fingerless gloves to help prevent accidental touches by the palm of my hand.

I use my iPad while wearing fingerless gloves to help prevent accidental touches by the palm of my hand.

The iPad: a Near-Miracle for My Son With Autism - Shannon Des Roches Rosa writes about her son Leo and how the iPad has helped him.

iHelp for Autism by the SF Weekly is a long and well balanced story which explains some of the iPads possibilities as well as its limitations, talking to teachers and other experts as well as parents of kids with autism. This article also includes sections about Leo and Des Roches.

Opinion: Why The iPad Isn??t For Me - Paul has quadriplegia and is an ardent iPod Touch user but for him the iPad would be a step backwards in terms of accessibility. In this article he explains why.

Karen Janowski has written Why I Love the iPad for Education: Initial Observations. Karen is an assistive and educational technology consultant who writes excellently and makes many good points.

The Muscular Dystrophy's Magazine, Quest, has published Barbara Twardowski's The iPad: A Disability Friendly Device? which evaluates the iPad for people with various types of disabilities. It's a balanced look at the pros and cons of the device, and lists ATMac as a website useful for people using an iPad so it must be a good article ;).

From the wonderful Katilea, an adult AAC user, we have several great posts about her new iPad:

N0thingbuteverything has written several articles about the iPad as used by her 5 year old son, 'S', who has cerebral palsy:

Kate Ahern from Teaching Learners With Multiple Special Needs has written iPossibilities for Those with Significant Special Needs and their Teams listing many apps suitable for those at the more severe end of the 'special needs' spectrum.

Trying out an iPad in Greece - this is definitely a world-wide phenomena.

Trying out an iPad in Greece- this is definitely a world-wide phenomena.

Caleigh's Mum writes about her daughter's use of the iPad with Proloquo2Go for communicating. Caleigh has cerebral palsy and there are several videos of her using the iPad included too:

Heidi has established a whole blog - Junior's Voice - about her son's journey with the iPad as a communications device. He uses the iPad via eyegaze with a helper holding the iPad to "read" the eyegaze and physically touch the screen in the right places.

Finally one of my favourite bloggers, Glenda Watson Hyatt, who has cerebral palsy also got herself an iPad and has been surprised by its usefulness:

In personal news, I have just got my own Mac back after it spent two weeks out of action after the video card, so I had only the iPad and my iPod Touch to keep me occupied. I learned a lot about using the iPad which I'm going to show you in future posts. Unfortunately I also got tendonitis in my hands from using them too much, and I have a hernia repair operation scheduled in a week's time, so I'll be at least partially out of action for a few more weeks and ATMac will be slow. Please be patient with me while I work on healing!

Hope you enjoyed the stories above - what other iPad disability-related stories have you seen?

- Ricky Buchanan