Posts Tagged with 'neurologically-impaired'

Speech-to-Text: Dictation software for Mac OS X

A microphone

Speech-to-text software, sometimes known as dictation software, is something that lets you talk to the computer in some form and have the computer react appropriately to what you are saying. This is totally different to text-to-speech software, which is software can read out text already in the computer.

Command and Control Software

There are two types of speech-to-text software available. One type is called "command and control" and it lets you speak commands to your computer to control it; hence the name. For example, a command that the computer understands might be, "go to the Apple website" or, "tell me the time". Each command is pre-programmed and the computer will only recognise those commands it's been programmed for; you can't use this software to write an email or use iChat for example.

Command and control software for the Mac - known as "Speakable Items" (or sometimes, confusingly, "spoken commands") - is already built into every OS X computer, although most people don't know about it. You don't need to download, buy, or install anything to get this software to work, just a microphone that works with your computer. The main drawback is that the Speakable Items software programmed for English with a standard American accent, and has significant trouble with any other accent. It doesn't function at all with languages other than English.

Some resources for getting you up and running with Speakable Items include:

Dictation Software

The other type of speech-to-text software is usually called "dictation" software. This is the type that lets you write an article like this one, type stuff to your friends in iChat, or type an email. The most common Windows software for speech to text dictation - you've probably heard of it - is Dragon NaturallySpeaking. There is only one dictation-capable speech-to-text software available for OS X which is being updated and developed and it's [msd]. Dictate is the successor to a program named iListen which MacSpeech used to produce.

MacSpeech Dictate iconLike all dictation-capable text-to-speech products, MacSpeech Dictate works very well for some people and very badly for others. Whether it will work for you depends on many things including: how much effort you're willing to put into learning it, how good your microphone is, your age (text to speech usually works less well for children), how much your accent matches what the program expects, and whether your voice changes a lot through the day.

MacSpeech Dictate is also still fairly new software - it was only released on the 15th of February, 2008. In comparison, the premiere speech recognition program for Windows is Dragon NaturallySpeaking which has been in development since the 1980s[1].

When MacSpeech Dictate was originally released it had several major problems which made it unusable for people with disabilities, but most of these have now been resolved:

  • There was no good help functions inside the application - this was rectified in Dictate version 1.3
  • It didn't learn from corrections - this was rectified in Dictate version 1.2
  • Couldn't spell words out by voice - this was rectified in Dictate version 1.2
  • Couldn't request individual key presses (such as command-s or command-option-escape) by voice - this was rectified in Dictate version 1.3
  • Couldn't be taught new words, such as names or jargon specific to your profession - this was largely rectified in Dictate version 1.2, although some words still resist training
  • There was no way to control the mouse by voice - this was finally rectified in Dictate version 2.0.

I tried using the old iListen program a few years ago and could not get results that were useful, an on-screen keyboard was the best solution at the time. Although MacSpeech Dictate is in its early days as a program, its recognition of my particular voice is hugely better than iListen's was. This is not surprising though, as MacSpeech Dictate's speech recognition engine is based on the same engine used by Windows' Dragon NaturallySpeaking - widely recognised as the best consumer speech recognition available.

[msd] requires the requires Intel-based Macintosh hardware and requires Mac OS X 10.5.6 (Leopard) and higher. Thirteen English dialects/accents are supported, and US and UK spelling options. These are:

  • US Spelling
    • American
    • American - Inland Northern
    • American - Southern
    • American - Teens
    • Australian
    • British
    • Indian
    • Latino
    • Southeast Asian
  • UK Spelling
    • Australian

    • British

    • Indian

    • Southeast Asian

Specialised versions - Dictate Medical and Dictate Legal - are available for dictating in these language areas, and Dictate International is now available and recognises speech in French, German, and Italian. MacSpeech have strongly hinted that Spanish language recognition is next on their agenda.

MacSpeech Dictate is a great program for dictation and some computer control, but it is not something that will let you control the computer completely "hands free". For quadriplegic users and others who need full computer control, you will need to supplement Dictate with use of a mouth stick and keyboard, or a program such as SwitchXS for switch access to functions not available by voice. I highly recommend Dictate though, it's part of my suite of accessibility technology and I use it whenever I am able to.

Website: [msd]

- Ricky Buchanan

[msddisclaim]

[msdbanner]

Time-Independent Games

Drop7Most "standard" computer games get harder because they get faster, relying on the player's reflexes and coordination keeping up. For example, in Tetris the blocks appear and drop faster and faster as your level increases:

Tetris

Tetris, like most single player games, devolves into twitch gameplay as the levels increase.

Untimed games or time-independent games are those where you aren't penalised if you play a game very slowly, have bad reflexes, or don't posses the hand-eye coordination to time your movements accurately. Games like this are "turn-based" where any game actions only occur in response to the player's actions, and don't have any other timers or time-related limitations. One of my favourite time-independent games, Drop7, is another block-dropping game but each block only "falls" once you tell the game where to put it. Drop7 increases the difficulty by changing the mix of blocks which are dropped and by adding a layer of hidden (grey) blocks at the bottom of the screen after a number of moves:

Drop7

Drop7 increases the game's difficulty level by changing the pieces available.

Time independent games share all of these things:

  • Game pieces aren't animated in a way that changes where you need to hit them, so taking extra time to initiate a move doesn't cause your target to shift.
  • There is no timer limiting the amount of time you can take to play each move or the time taken for the overall game.
  • Being fast or slow doesn't change the number of points awarded for each move or for an overall game.
  • The app doesn't "reset", losing your position in the game, if the device is turned off.

If you aren't sure if a game fits all these requirements, a good way to check yourself is to open the game and choose exactly where you'll tap the screen to make a move ... then put the device down for 5 minutes before coming back and tapping the screen exactly where you had previously decided. If there's no disadvantage (or advantage) to your 5-minute pause that's time-independent. If you could do the same pausing routine at any point during the game then the whole game is time-independent.

Why would you want to know if a game is time-dependent or not? There are a large number of disabilities that affect timing, most of which come under these general categories:

  • Conditions that affect perception (eg vision impairment, conditions affecting how the brain interprets perceptions, sensitivity to animated movement) which may slow down how fast you understand what the game's state is.
  • Conditions that affect thinking or memory (eg brain injury, intellectual impairment, memory impairment) which may slow down your decision about which move to make.
  • Conditions that affect movement or reactions in the limbs used to control the iPad (eg cerebral palsy, quadriplegia) which may slow down your ability to make the move you've decided to make.

An extra effect of time-independent games is that collaborative gameplay becomes possible. This could be a parent playing with a child, two friends playing together, a therapist playing with a client, or a partner-assisted play scenario where the player indicates their desires by their own methods and the partner physically touches the game devices for them.

Mahjong

Computer implementations of board games are almost always untimed, so they're excellent for collaborative or partner-assisted gameplay.

A surprisingly small number of games actually fit the requirements for being fully time-independent, so for this list I'm broadening the definition a little. If the game does have some time-dependent elements but these can be adjusted by the player or aren't essential to regular play then I'll make a note of this in the list:

These others are games that people have suggested may be time-independent, but which I haven't tested myself:

What's your favourite time-independent game?

- Ricky Buchanan

Tetris image sourced from WikiMedia Commons: GPL.

iPad Keyguards Available

An iPadThe American company Lasered Pics is now making keyguards available for the iPad. Keyguards are available which conform to the shape of the standard iPad keyboard and special-purpose keyguards for Proloquo2Go, TapSpeak Choice and Speak It! are also available. All iPad keyguards are made from 1/8" (0.3cm) thick clear acrylic and come with optional 1/16" (0.15cm) bumpers which can raise the keyguard above the screen to prevent accidental touches.

Standard iPad keyboard guards come in both landscape and portrait orientations and will suit QWERTY, AZERTY and QWERTZ keyboard layouts.

Proloquo2Go keyguards are also available for both portrait and landscape orientations and keyguards can be ordered that suit all current Proloquo2Go options including standard and large toolbar sizes, and optionally "wide" mode. Tap Speak keyguards can be made to suit 2-56 items and also come in portrait and landscape orientations. Speak It doesn't have any layout options available at the moment. Lasered Pics report they will be designing a keyguard to suit Proloquo2Go's word prediction mode keyboard, and are also working on keyguards for additional AAC apps.

Clear plastic rectangle with smaller holes cut into it

Keyguard for Proloquo2Go in landscape mode

Lasered Pics keyguards can be used with the standard Apple iPad case, with no case, or with any other case that does not obstruct the front of the iPad. The website advises that the current keyguards will not fit properly when used with the OtterBox iPad case.

Keyguards are smaller than the iPad's full size so they should fit both the original iPad and iPad 2 with no problems.

iPad with a keyguard

The iPad keyguard covers the home button and fits inside some cases

Current keyguards also cover the "home" button but this may be optional in the future. I can imagine it would be a bonus for some users, as preventing access to the "home" button has been a problem for some.

Steve from Lasered Pics has advised me that anybody wanting a keyguard for a different iPad application should contact him via the website. He couldn't give me a price for a custom keyguard as it depends on too many factors, but it can certainly be done.

Standard iPad keyguards cost US$19.95 each, but until 31 March 2011 you can get a 10% discount for ordering 2 or more TapSpeak keyguards - use the promo code TAPSPEAK when checking out!

- Ricky Buchanan

MovieCaptioner 4.2

Generic QuickTime Movie Icon

MovieCaptioner keeps repeating a segment of the movie until you are done typing what you hear. Just hit the Return key and it will save your caption and automatically advance to the next few seconds of the movie, allowing you to zip through your captioning tasks in no time flat.

You don't need to be a QuickTime guru, either. The caption track is added automatically with the click of a button. And exporting Transcripts compiles all the captions into one concise text file, with or without timecode.

I've written about MovieCaptioner before - it used to be called MovCaptioner - but there have been significant improvements in both the interface and in the type of captions MovieCaptioner can read and create. The website now lists all these types of imports and exports:

  • QT Text
  • QT Unicode (export only)
  • QT SMIL (export only)
  • Flash DFXP
  • JW Player
  • CLF Player (Canada)
  • Adobe Encore
  • Sonic Scenarist SCC (for Final Cut Pro, line 21 close captions and iPod/iPad captions)
  • Spruce (STL)
  • SubRip (SRT)
  • SubViewer (SUB)
  • Windows Media (SAMI, export only)
  • Text Transcripts
  • HTML Transcripts (export only)
  • YouTube SBV (import only)

I think the creation of Flash captions is especially exciting, given the number of uncaptioned Flash movies out there on the internet. Now that Flash supports simple captioning, and programs like MovieCaptioner let captioning be done for such a low price, there's absolutely no reason not to caption Flash movies and tutorials you make for your website.

MovieCaptioner will also import YouTube's auto-caption files so you can correct them and then re-upload them to YouTube for efficient and accurate YouTube captioning.

SynchriMedia offer several video tutorials for MovieCaptioner including a nifty one for how to use MovieCaptioner and [msd] together so you can caption your film quickly without even needing to type!

- Ricky Buchanan

Putting Bookshare.org Books On The iPad

Logo for Bookshare serviceAs the Technology Coach for Educational Vision Services, the program in the NYC Department of Education that serves students in our school system with visual impairments, I have been looking for a way to provide students with low-vision access to large print using the iPad. Our students are registered with Bookshare.org but it has been a stumbling block converting the DAISY formatted books into the epub format that can be read on the iPad. While there are numerous options for our students who are auditory or Braille readers, there has been a large disconnect in taking advantage of technology for our students who require large print and alternate contrast for visual reading.

The first thing I noticed is that while the iBooks app is great, it doesn't provide the flexibility in adjusting text size and contrast that is available in the free app Stanza. I tested it with several visually impaired students and determined that Stanza was preferable for reading books on the iPad.

Calibre is a free, cross-platform e-book convertor. While it won't recognize DAISY, it will recognize HTML documents. Firefox can open up the XML file in the DAISY book folder downloaded from Bookshare. Using Firefox, you can convert the XML file to an HTML file that Calibre recognizes and retains most of the book's format, including images in the DAISY book. This is particularly useful for NIMAC sourced textbooks that rely heavily on graphics.

During the Welcome Wizard, I set up Calibre to save files to an eBook folder I created in my Documents folder. While I chose the iPad as my Output Profile, it did not stick and had to be selected again in Calibre's Common Options Preference pane. The Base Font size can be adjusted in the Common Options Preference pane as needed by the intended reader. Calibre takes the HTML file and converts it to an epub file, saving it in a folder sorted by the author.

I wanted to find a way of transferring the epub book to the iPad without having to worry about syncing the iPad each time. Dropbox proved to be perfect for this. A teacher can share a folder with the student and use it to transfer the book to the iPad wirelessly. This is especially helpful the majority of our students are served using the itinerant model and the teacher can get the book on the iPad remotely.

While Dropbox cannot open the epub, it will transfer the book to the Stanza app. Once in Stanza, the text can be adjusted to the reader's preference for size and contrast. The iPad's built in Zoom can provide even further magnification if needed.

I understand this is a bit laborious and I am looking for a method to automate the process. I needed a way that would work on both Macs and Windows as our schools are cross platform. I also wanted to focus on a method using free software as we are a school system and budget is a concern.

What you need

Note that all of these applications and apps are free.

  • On your own computer, install these - they will all install correctly on Windows, Mac, and Linux-based computers:
  • Onto the iPad, iPhone, or iPod Touch where you want the books, install these (links are directly to the App Store):

After you have unzipped the downloaded book from Bookshare, these are the steps to take on your own computer:

  1. Open Firefox. Use the File>Open File command and open up the XML file in the Bookshare book's folder.
  2. In Firefox, select File>Save Page As. Navigate to your preferred folder (I created one called eBooks for this purpose), rename the file to the book's title with the extension ".html" and in the Save As drop down box, select Web Page, Complete. Quit Firefox.
  3. Open Calibre. Add the HTML file you created in step 2 to your Calibre library. For larger NIMAC books, especially ones with lots of graphics, this can take a long time. You will need to add the author's name as this is not picked up by Calibre.
  4. Select the book in the Calibre library list and choose the Convert Book icon. You can adjust the Base Font Size by clicking on the Look & Feel icon in the left pane. Click the OK button to process it.
  5. Navigate to the author folder created by Calibre. Open the book folder and find the .epub file created by Calibre. Transfer it into your Dropbox.

The next steps must be taken on the iPad (or iPhone or iPod Touch) where you want the book to be read:

  1. Open the Dropbox App on the device. Select the book you transferred in the previous step. After Dropbox attempts to open it on your iPad, you will get a message that Dropbox cannot open the file. This is fine. In the upper right hand corner of the screen, select the "Transfer to" icon. Select Stanza from the list.
  2. Stanza will open up and import the book. You can now read it the book in Stanza, adjusting the font, text and background colors to your preference. Images will not be magnified but you can use the iPad's Zoom feature to enlarge them if necessary.

- David H Cohen