Speech-to-text software, sometimes known as dictation software, is something that lets you talk to the computer in some form and have the computer react appropriately to what you are saying. This is totally different to text-to-speech software, which is software can read out text already in the computer.

Command and Control Software

There are two types of speech-to-text software available. One type is called "command and control" and it lets you speak commands to your computer to control it; hence the name. For example, a command that the computer understands might be, "go to the Apple website" or, "tell me the time". Each command is pre-programmed and the computer will only recognise those commands it's been programmed for; you can't use this software to write an email or use iChat for example.

Command and control software for the Mac - known as "Speakable Items" (or sometimes, confusingly, "spoken commands") - is already built into every OS X computer, although most people don't know about it. You don't need to download, buy, or install anything to get this software to work, just a microphone that works with your computer. The main drawback is that the Speakable Items software programmed for English with a standard American accent, and has significant trouble with any other accent. It doesn't function at all with languages other than English.

Some resources for getting you up and running with Speakable Items include:

• Get Siri-like Functionality on your Mac with Speakable Items (video with full transcript available)
• Apple Support Articles about Speakable Items

Dictation Software

The other type of speech-to-text software is usually called "dictation" software. This is the type that lets you write an article like this one, type stuff to your friends in iChat, or type an email. The most common Windows software for speech to text dictation - you've probably heard of it - is Dragon NaturallySpeaking. There is only one dictation-capable speech-to-text software available for OS X which is being updated and developed and it's [msd]. Dictate is the successor to a program named iListen which MacSpeech used to produce.

Like all dictation-capable text-to-speech products, MacSpeech Dictate works very well for some people and very badly for others. Whether it will work for you depends on many things including: how much effort you're willing to put into learning it, how good your microphone is, your age (text to speech usually works less well for children), how much your accent matches what the program expects, and whether your voice changes a lot through the day.

MacSpeech Dictate is also still fairly new software - it was only released on the 15th of February, 2008. In comparison, the premiere speech recognition program for Windows is Dragon NaturallySpeaking which has been in development since the 1980s[1].

When MacSpeech Dictate was originally released it had several major problems which made it unusable for people with disabilities, but most of these have now been resolved:

• There was no good help functions inside the application - this was rectified in Dictate version 1.3
• It didn't learn from corrections - this was rectified in Dictate version 1.2
• Couldn't spell words out by voice - this was rectified in Dictate version 1.2
• Couldn't request individual key presses (such as command-s or command-option-escape) by voice - this was rectified in Dictate version 1.3
• Couldn't be taught new words, such as names or jargon specific to your profession - this was largely rectified in Dictate version 1.2, although some words still resist training
• There was no way to control the mouse by voice - this was finally rectified in Dictate version 2.0.

I tried using the old iListen program a few years ago and could not get results that were useful, an on-screen keyboard was the best solution at the time. Although MacSpeech Dictate is in its early days as a program, its recognition of my particular voice is hugely better than iListen's was. This is not surprising though, as MacSpeech Dictate's speech recognition engine is based on the same engine used by Windows' Dragon NaturallySpeaking - widely recognised as the best consumer speech recognition available.

[msd] requires the requires Intel-based Macintosh hardware and requires Mac OS X 10.5.6 (Leopard) and higher. Thirteen English dialects/accents are supported, and US and UK spelling options. These are:

• US Spelling
  • American
  • American - Inland Northern
  • American - Southern
  • American - Teens
  • Australian
  • British
  • Indian
  • Latino
  • Southeast Asian
• UK Spelling
  • Australian
  
  
  • British
  
  
  • Indian
  
  
  • Southeast Asian

Specialised versions - Dictate Medical and Dictate Legal - are available for dictating in these language areas, and Dictate International is now available and recognises speech in French, German, and Italian. MacSpeech have strongly hinted that Spanish language recognition is next on their agenda.

MacSpeech Dictate is a great program for dictation and some computer control, but it is not something that will let you control the computer completely "hands free". For quadriplegic users and others who need full computer control, you will need to supplement Dictate with use of a mouth stick and keyboard, or a program such as SwitchXS for switch access to functions not available by voice. I highly recommend Dictate though, it's part of my suite of accessibility technology and I use it whenever I am able to.

Website: [msd]

- Ricky Buchanan

[msddisclaim]

[msdbanner]

Guest post by Blake Watson.

I've tried a lot of remote apps, but for me, HippoRemote gets the nod. Once you go through a surprisingly painless setup process, HippoRemote will connect to your computer and hand the reins over to you. Your iPhone is now a fully-featured multi-touch trackpad. Tap the keyboard button at the top of the screen and HippoRemote will provide you with a standard iPhone keyboard with some extra features attached. Explore further, and you will see that HippoRemote turns your iPhone or iPod Touch into an advanced media browser that lets you interact with some of the coolest media programs on your Mac, including the built in stuff like iTunes and Front Row as well as third party apps like Boxee and Hulu Desktop. Let's walk through some of HippoRemote's features. HippoRemote comes in a few different flavors, so we'll be looking at HippoRemote Pro.

The Keyboard

The keyboard behavior of HippoRemote is arguably the best available on a remote app. Most standard iPhone keyboard behavior is present. For example, spacing after a period or a comma will change the keyboard from the punctuation layout back to the alphabet layout. Tapping the shift key once will keep it activated until you tap a letter, then it is deactivated. If you want CAPSLOCK then double tap the shift key to activate it, then tap it once when your done. These behaviors are the Apple standard, but many remote apps do not use them because of the way characters are sent to the computer. I find that these behaviors are important because they increase typing efficiency.

In addition to replicating iPhone's standard keyboard behaviors, HippoRemote takes advantage of iPhone's built-in ability to predict what you are writing. HippoRemote displays what you are typing in a text field on the phone at the same time that it is sending it to your computer. If you misspell a word, you can tap on it to see substitutes and HippoRemote will make the correction on your computer automatically. HippoRemote also displays a list of the last few strings you've typed. Touching one will re-type that string.

Besides standard keyboard layouts, HippoRemote provides arrow keys and modifier keys (command, option, etc.) as well as the full range of function keys.

HippoRemote adds one feature that I haven't seen in other remote apps: it has support for TextExpander Touch. TextExpander Touch allows you to create snippets of text that can be automatically triggered by specified shortcodes (eg, "fn" could expand to your full name). You don't need TextExpander on your Mac for these to work, as TextExpander Touch expands the snippets before they're sent to the computer.

The keyboard supports vertical and horizontal orientations. And in the Basic or Lite versions of HippoRemote, the keyboard and the trackpad can be displayed at the same time.

Multi-touch trackpad

The multi-touch trackpad features left and right mouse buttons as well as the ability to use tapping, two-finger scrolling and other gestures. If you are like me, and have trouble using more than one finger, you will appreciate HippoRemote's unique scroll button. By moving your finger from the bottom of the screen to the middle, you activate a scrolling knob that allows you to scroll by moving your finger in a clockwise or counter-clockwise motion. That means you can use one finger to scroll without the need to look down.

Like the keyboard, the trackpad supports vertical and horizontal orientations.

Profiles for Remote Control Panels

HippoRemote Pro can change its interface based on what application you are using. For example, I am currently in the Mac OS profile. At the bottom of the trackpad area, there are several buttons that allow me to do things like trigger Spotlight and Expose or run macros that control volume, press eject, open Dashboard and other functions. Switching to the iTunes profile provides a control panel for manipulating playback. Switching to the Pandora profile allows you to control the Pandora web app. There are dozens of profiles installed with HippoRemote and more can be added from inside the app itself. If you are technically inclined, there are instructions for making your very own profiles.

Extras

On top of all these great features, HippoRemote includes a native web browser and Twitter client. You can even open links from HippoRemote's Twitter client directly in your Mac's web browser.

Different Versions

HippoRemote comes in three flavors: HippoRemote Lite (free, ad-supported), HippoRemote Basic ($1.99USD), and HippoRemote Pro ($4.99USD). Unfortunately, it's a bit confusing as to what features are found in which versions. For the purpose of this review, I used the Pro version. If you are looking to replace a keyboard, I recommend getting the Pro version. At about five bucks, you'll be getting all of HippoRemote's features at a fairly inexpensive price compared to most assistive technology software. However, if having the trackpad and keyboard display simultaneously would be useful for you then you will want to grab the basic version.

If you need to know about a specific feature and you can't find it on the HippoRemote website, feel free to contact the developer. He actually has an interest in making HippoRemote even better for people with disabilities and will value any feedback you provide. That being said, you can always send me an email too.

Alternative Apps

Here are some other apps that are similar to HippoRemote. Depending on your needs, one of these might work better for you. I have these apps installed on my iPhone. Although I am not planning to review them at the time of this writing, you can email me if you have questions about them.

Rowmote Pro, $4.99USD, by Evan Schoenberg

Designed for iPhone and iPad, good keyboard behavior, can display keyboard and trackpad simultaneously, can simulate the Apple Remote Control including support for dozens of applications.

TouchPad, $4.99USD, by Edovia, Inc.

Designed for iPhone and iPad, good keyboard behavior, can display keyboard and trackpad simultaneously, great user interface, Windows compatible, media remote.

Touchpad Elite, $0.99USD, by iTeleport LLC

Good keyboard behavior, can type locally and then send a paragraph at once, can display keyboard and trackpad simultaneously, Windows compatible, media remote.

Air Mouse Pro, $1.99USD, by R.P.A. Tech, INC

Optional accelerometer-based "air" mouse activated by physically moving the iPhone/etc in the air, good keyboard behavior, can display keyboard and trackpad simultaneously, Windows compatible, media remote, separate iPad compatible app.

Conclusion

If you can operate an iPhone or iPod Touch, you might find that typing with HippoRemote is faster and more efficient than typing with an onscreen keyboard. And as an added bonus, you get some powerful, easy-to-use controls for interacting with popular media applications. And if you happen to be a Windows user, you're in luck. HippoRemote is compatible with Windows and Linux as well as Mac OS X.

- Blake Watson

There have been a plethora of stories in the mainstream news and in blogs about the iPad and the amazing positive effects it's having for people with various disabilities. Children with autism are the subject of many of these stories, but there are plenty of others who are getting amazing results from their iPads too.

I haven't been able to keep up with all the stories, but here's a round-up of some of them. If you know of more, please leave a comment at the bottom of this post:

The Wall Street Journal itself has written about the iPad for people with disabilities: Using the iPad to Connect: Parents, Therapists Use Apple Tablet to Communicate With Special Needs Kids is a great article and includes quotes from Steve Jobs and also a video showing some use of the iPad:

Making weird cool - Robert Rummel-Hudson talks about why he thinks the iPad is a game-changer for AAC and why it's important to have devices that don't say "I have a disability!" as soon as you walk into a room with one.

Zach's A Mac - Zach is a 3 1/2 year old boy with cerebral palsy who's learning to use an iPad.

The iPad: a Near-Miracle for My Son With Autism - Shannon Des Roches Rosa writes about her son Leo and how the iPad has helped him.

iHelp for Autism by the SF Weekly is a long and well balanced story which explains some of the iPads possibilities as well as its limitations, talking to teachers and other experts as well as parents of kids with autism. This article also includes sections about Leo and Des Roches.

Opinion: Why The iPad Isn??t For Me - Paul has quadriplegia and is an ardent iPod Touch user but for him the iPad would be a step backwards in terms of accessibility. In this article he explains why.

Karen Janowski has written Why I Love the iPad for Education: Initial Observations. Karen is an assistive and educational technology consultant who writes excellently and makes many good points.

The Muscular Dystrophy's Magazine, Quest, has published Barbara Twardowski's The iPad: A Disability Friendly Device? which evaluates the iPad for people with various types of disabilities. It's a balanced look at the pros and cons of the device, and lists ATMac as a website useful for people using an iPad so it must be a good article ;).

From the wonderful Katilea, an adult AAC user, we have several great posts about her new iPad:

• Proloquo2Go and iPad: A Marriage made in Heaven!
• Physical Accessibility on iPad in General, for People with Fine Motor Difficulties
• AAC: Mainstream V Dedicated Devices
• iPad useful for Ataxians?

N0thingbuteverything has written several articles about the iPad as used by her 5 year old son, 'S', who has cerebral palsy:

• Proloquo2go and the iPad Review - a detailed review of Proloquo2Go and the iPad
• Proloquo2go?what I learnt next - More reviewing of Proloquo2Go, as well as a wish list of things she'd like to see in future upgrades.

Kate Ahern from Teaching Learners With Multiple Special Needs has written iPossibilities for Those with Significant Special Needs and their Teams listing many apps suitable for those at the more severe end of the 'special needs' spectrum.

Caleigh's Mum writes about her daughter's use of the iPad with Proloquo2Go for communicating. Caleigh has cerebral palsy and there are several videos of her using the iPad included too:

• Caleigh's Communication Part 4 - iPad
• iPad + Proloquo2Go, 1 Month Update
• Caleigh's Communication - The Review

Heidi has established a whole blog - Junior's Voice - about her son's journey with the iPad as a communications device. He uses the iPad via eyegaze with a helper holding the iPad to "read" the eyegaze and physically touch the screen in the right places.

Finally one of my favourite bloggers, Glenda Watson Hyatt, who has cerebral palsy also got herself an iPad and has been surprised by its usefulness:

• The iPad as an Affordable Communicator: Initial Review
• The iPad as an Affordable Communicator: A Follow-up Review
• Writing Under the Stars: A Follow-Up iPad Review

In personal news, I have just got my own Mac back after it spent two weeks out of action after the video card, so I had only the iPad and my iPod Touch to keep me occupied. I learned a lot about using the iPad which I'm going to show you in future posts. Unfortunately I also got tendonitis in my hands from using them too much, and I have a hernia repair operation scheduled in a week's time, so I'll be at least partially out of action for a few more weeks and ATMac will be slow. Please be patient with me while I work on healing!

Hope you enjoyed the stories above - what other iPad disability-related stories have you seen?

- Ricky Buchanan

I've had "wireless multi-touch trackpad" at the top of my person Apple wishes for several years now, so I was thrilled at Apple's announcement announcement of the Magic Trackpad yesterday. The announcement itself was somewhat hidden amongst announcements of updates to the iMac series, which now have faster processors and better graphics capabilities, but the Magic Touchpad is of special interest to users with disabilities.

From Apple's website:

Desktop users, your time has come. The new Magic Trackpad is the first Multi-Touch trackpad designed to work with your Mac desktop computer. It uses the same Multi-Touch technology you love on the MacBook Pro. And it supports a full set of gestures, giving you a whole new way to control and interact with what's on your screen.

And by "full set of gestures" they really mean all of them - this device uses the same preference pane as the MacBook touchpads use. This is fantastic news especially for iMac and Mac Pro users who use the VoiceOver screen reader, as the revolutionary "touchpad as screen" where you can control the screen reader using gestures like an iPhone or iPad.

Daniel Rowe, from the MacVisionaries group - a mailing list for blind Mac users, took the plunge yesterday and bought himself a Magic Trackpad. He said:

I've only used VO [VoiceOver] with multi-touch trackpads briefly before as I have an iMac. But because I use the iPhone I could see the benefits such an interface would bring to Mac OS.

Having spent nearly two days with the trackpad, I personally thing that it is the best thing to happen in assistive technology recently. To be able to visualise how things are laid out on the screen is just amazing. It's larger size is also an advantage. It has really changed the way how I use my Mac and I won't be going back to using the numpad commander unless I have to.Daniel Rowe

He mentions the larger size - I can't find any specific dimensions on Apple's website but from looking at their photos of the Magic Trackpad beside a bluetooth keyboard and judicious use of a ruler on my own Apple bluetooth keyboard I think the active area on the Magic Trackpad must be close to 11cm by 11cm, or just under 4 1/2 inches in either direction. That's a lot larger than the MacBook trackpads, which should also help those who have trouble with fine motor control, or find making small gestures difficult for any reason. Reviewers on the Apple website also mention it makes it possible to use two hands to make gestures needing more that one finger.

The Magic Trackpad also has a physical click (the entire trackpad depresses if you click it) as well as a tap-to-click, either of which can be enabled or disabled as desired. Many other features can be customised to fit the users needs and preferences too. I'm sure I'll be writing more about the options and set-up when mine arrives, but until then here's a peek at the preference pane:

The Magic Trackpads seem to be available from all Apple stores around the world immediately (including online stores), but those countries served by non-Apple-branded stores will have to wait a few weeks. The Australian online Apple store is shipping these currently and estimating 24hr delivery time, for example, but my local Mac-licensed stores are estimating the end of July as the earliest they'll have stocks available.

-- Ricky Buchanan

PinPoint is a program which puts an animated or static graphic around your mouse pointer when you want it, so you can always locate the cursor. Great for people whose eyesight isn't the best, or users who have large or multiple screens. I find PinPoint to be most helpful when I'm typing or reading text and the mouse pointer turns into the tiny and hard-to-locate "I beam" cursor that I can never see.

OS X does have a built in method for enlarging your mouse pointer but the pointer gets blocky when it's more than about 1.5 times normal size, and there's no option to change the colour of the mouse pointer or do anything else to make the pointer more visible. This is where PinPoint, or similar programs, can help you.

There are a plethora of options which can be set about when the PinPoint graphic is visible:

The way I have the settings means the graphic is always visible, which is my preference, but it can be set to only show up briefly when you move the mouse or when the computer wakes up, or even only when you press a key combination - that's the "Toggle Key" keystroke you see in the graphic.

Every pointer in the default library also has at least 4-5 options which can be set. The PinPoint graphic on your mouse pointer will change in real time as you change the options, so you can get it exactly right. If you are switching cursor options quickly the cursor graphic may become jumpy for a few seconds until it's properly loaded into the system, but I had no other problems testing multiple options on every cursor available.

There is a great library of free pointer surrounding graphics, some static and some animated, which can be downloaded for PinPoint 3 users. Some pointers also respond to mouse clicks by changing their animation briefly so you know your click was successful.

PinPoint 3 can be trialled for 15 days for free, and costs US$10 to register. It works for users of OS X 10.4 and up but the very latest version requires version 10.5 and up.

- Ricky Buchanan