Tuesday, September 2, 2008

iPhone speech recognition - status

The iPhone mania is pushing many vendors to offer speech recognition on this platform. As there are many offerings, I enclose a summary to ensure a simple presentation of the current status. I am not certain it covers all iPhone speech offering and will be glad to receive comments about additional speech recognition solutions for the iPhone.

There are many posts on the net about speech recognition around iPhone, some for command and control and some for perfroming free speech web search. Many people are disappointed that there is no speech recognition for iPhone while other are discussing working or semi-working applications and few names are mentioned:
  1. AT&T
  2. Nuance
  3. VoiceSignal
  4. VoiceDialer
  5. VOICE DIAL
  6. VoiceThis
  7. Fonix


AT&T exposed recently a research project - Watson Speech Mashups Architecture - a new software framework that casts AT&T’s WATSON speech recognition as a web service to economically bring speech processing technologies to the larger web and mobile developer community. This new capability provides network-hosted speech technologies for multimedia devices with broadband access (iPhone, BlackBerry®, IPTV set-top box, SmartPhones, etc.) without the need to install, configure, and manage speech recognition software and equipment. This enables easy and rapid development of new speech and multimodal mobile services as well as new web-based services. The software implementation is based on well-established web programming models, such as SOA, REST, AJAX, JavaScript and JSON.

AT&T provides a video of the YellowPages.com application with speech recognition on an iPhone.



Nuance & VoiceSignal are promoting separate solutions or maybe the same one? VoiceSignal is part of Nuance but still exposed its own iPhone speech recognition solution. I am confused and I bet many others inside Nuance are confused.

I wrote in the past about the Nuance iPhone offering. What I managed to understand from the various announcements is that Nuance named its solution OVS for open voice search (in some cases it is referred to as open vsearch). It is also known as the Mobile Solution Suite. Surprisingly on the VoiceSignal website, there is a demo video of vSearch which is a speech recognition based search application for iPhone. The application logo displayed on the iPhone in this video is the VoiceSignal logo (unlike the logo on the Nuance vsearch demo which is of course the Nuance logo).
If you are still not confused, take a look at the Nuance announcement from June 10th and compare to the VoiceSignal announcement from August 24th:


Nuance Unveils Voice Search Prototype On iPhone

APPLE WWDC, SAN FRANCISCO. June 10, 2008 — Nuance Communications, Inc. (NASDAQ: NUAN), a leading provider of speech solutions, today unveiled a ground-breaking prototype for voice search capabilities shown on the Apple iPhone (NASDAQ: AAPL).


The newly designed application introduces a new, more compelling consumer and search experience. Through Nuance speech recognition servers, mobile consumers — with no training required — can simply speak requests into their phone like “Find the Apple store in Boston, Massachusetts,” “Score of the Boston Celtics game,” or “Play Hannah Montana Best of Both Worlds” to quickly and accurately search the mobile web or in the future dictate an IM, SMS or e-mail message. The prototype, code-named “OVS” for open voice search, will allow mobile operators to offer simple ‘say anything’ search capabilities and is search engine agnostic, able to link to any search engine of an operator’s choosing. A video demonstration of the new application can be found at www.nuance.com/mobilesuite.



VoiceSignal Voice Enables iPhone in Proof of Concept Development

WOBURN, Mass., August 24, 2007– VoiceSignal Technologies, Inc., a leading supplier of speech recognition solutions, today announced that VoiceSignal engineers have ported several of VoiceSignal’s applications to the iPhone. These initial proof-of-concept applications include VSearch (mobile local search by voice) and VTunes (voice enabled music player).

The video demonstrations can be found either on the VoiceSignal website (www.voicesignal.com) or on the following YouTube links:

VTunes: http://www.youtube.com/watch?v=zne4rwCCmAc
VSearch: http://youtube.com/watch?v=ayrCCw5xWug


I am surprised by the Nuance marketing performance on this issue. I hope that someone from Nuance will wake up to clear this issue and maybe add some comments to enable us understand their offering.




SpeechCloud's VoiceDialer (free) was the first iPhone application to try to offer speech dialing on the iPhone. VoiceDialer takes advantage of the iPhone's always-on internet connection to record your voice and send it to SpeechCloud's servers to perform the actual recognition. Similar to the AT&T and Nuance approach. Once recognized, the application pulls up the contact's name and allows you to select which number to dial. Some of the criticism of the application is that it requires too much manual interaction (tapping on buttons) to actually dial a number, and slow response time due to the transferring of data across wireless networks.

VoiceDial ( by Makayama) ($ 14.99 on apple store) avoids actual speech recognition and instead perform audio comparison. VoiceDial requires you to actually record your own voice for each contact which can then later be used to match your voice command. If you are willing to pay the $15 and willing to record yourself saying your contacts, MercuryNews claims the product "works as advertised" and "had no problems recognizing the contact I wanted to call, even when it was similar to other names I'd recorded."

HRL Technologies' VoiceThis Dialer , ( $9.99) is an application that actually tries to perform speech recognition within the iPhone itself. No wireless connection required. Instead, the application runs within the iPhone. VoiceThis Dialer promises to offer completely hands free activity with the ability to dial contacts and even quit the application with your voice.

Fonix
Speech is currently developing iSpeak, which includes a run-time engine that sits on the phone allowing users to interact with the personal contents of their Apple iPhone™. Unlike other voice applets that enable voice search of the Internet by sending commands over the airwaves, this client-side application gives users the power of voice interaction with their personal content and eliminates network latency. Fonix iSpeak™ connects the user by just saying the phone number or by saying the name of a person in the contacts database. Additionally, users will be able to navigate their music libraries and launch a song or playlist simply by saying the name of the artist, song, or playlist.


To summarize, we are facing a proliferation of speech recognition applications on the iPhone.
A Key for the evolution of speech recognition on the iPhone is the 3G capability (which provides a fast channel to server side conmputing) and the platform openness - both released recently. As this two criteria are fulfilled, we should expect a quick growth in speech recognition applications availability for iPhone.

Tuesday, August 19, 2008

IBM is behind Vlingo's technology - will Nuance sue IBM?

Recently Nuance decided to play aggressively against Vlingo. While filing a lawsuit against Vlingo seems reasonable for Nuance who has a long history for using the lawsuit weapon against small companies (usually pre acquisition attempts). However the recent Business Week article - IBM's Speech Recognition, expose the fact that Vlingo is using the IBM technology as the basis for their solution.

I wonder if Nuance will continue the legal actions given this information. IBM speech recognition patents is one of the broadest in the industry and in general nowone should mess with IBM about patents.

Wednesday, July 16, 2008

Google Video Search via Speech Recognition




Finally a hint on the expected Google move to the speech recognition arena.

Google announced at the Official Google Blog, the availability of a new video search capability based on speech recognition.

It was release as a gadget you can embed on your iGoogle homepage and is a good preview of things to come.
The gadget only searches videos uploaded to YouTube's Politicians channels, which include videos from Senator Obama's and Senator McCain's campaigns, as well as those from dozens of other candidates and politicians. It usually takes less than a few hours for a video to appear in the index after it has been published on YouTube.

So apart from congratulations to the google team who are exposed to the public for the first time, how are they compared to other speech recognition engines aimed for broadcast quality? The google team refer to their precision: "While some of the transcript snippets you see may not be 100% accurate, we hope that you'll find the product useful for most purposes." While I do not understand what are the purposes for just searching within the YouTube political channel, people should be aware of much more mature solutions developed in the past years. From the pioneering work of BBN and IBM to the existing online solutions like everyzing, tveyes, blinx, snipp.tv by NSC and more. Based on the perceived quality, the google team has a long way to go in order to get to the first league and to be able to analyze data which is not at broadcast quality. The good news as users is that the YouTube data is easier to process relative to telephony calls speech recognition performed widely today at contact centers by companies like Verint, Nice, Autonomy, Utopy, Nexidia, CallMiner and other players.

Friday, July 11, 2008

SuperHuman Speech Recognition

Last week the the Speech Technologies Group at the IBM Haifa Research Lab (HRL) coordinated a full-day seminar on Speech Technologies. The seminar was a great success with more than 100 participants.

The Keynote presentation at the IBM Speech Technologies Seminar 2008 was: "Superhuman Speech Recognition: Technology Challenges and Market Adoption" by Dr. David Nahamoo, IBM Fellow, Speech CTO and Business Strategist, IBM Watson Research Center. You can view the presentation below. More presentations will be posted soon.




Read this document on Scribd: SuperHuman Speech Recognition Jul 2 2008

Saturday, July 5, 2008

11 Indian languages available from Nuanace


Nuance just extended their Indian languages support. In addition to Hindi and Indian English, they support also: Marathi, Malayalam, Tamil, Kannada, Telegu, Bengali, Gujrati, Oriya, and Punjabi.
I wonder what will be an automatic language identification results when trying to discriminate between these languages automaticallyl.




Nuance Communications Launches 9 New Indian Languages for Speech Recognition



By VARIndia Correspondent

Nuance Communications has released 9 new Indian languages for speech recognition in the contact centre...

Tuesday, June 17, 2008

Nuance-Vlingo: If you are not sued, you do not exi(s)t

Nuance is not only active to push speech based search to the iphone competing with the vlingo/Yahoo offering. Apparently, Nuance just filed a lawsuit against Vlingo for infringing one of their 1000 patents. Nuance and its predecessor (ScanSoft) has a long history of lawsuits which were in sync with their M&A and business strategy. In some cases, when competing on a large account or negotiating a good M&A price, Nuance used the lawsuit mechanism to get a better deal.

Just few examples from the past:


ScanSoft, ART could settle lawsuit with acquisition

"Peabody-based ScanSoft Inc. may settle a lawsuit by acquiring defendant ART Advanced Recognition Technologies Inc., according to an Israeli newspaper report.

The deal could amount to tens of millions of dollars, according to Globes Online, which attributed the report to a Hebrew newspaper called Yediot Ahronot."


ScanSoft files suit against Voice Signal

"Voice Signal Technologies Inc., a Woburn start-up that sells speech-recognition systems used in wireless phones, has been hit with a patent-infringement lawsuit by ScanSoft Inc., after Voice Signal refused to accept what executives yesterday called a lowball takeover bid from ScanSoft."

There is also the famous TellMe case.

I think it is a great feedback to Vlingo whose management includes are ex-Nuance employees. If you are not sued in this industry, you do not exi(s)t.

Sunday, June 15, 2008

iPhone speech recognition

The iPhone is attracting many developers wishing to add its next cool application. Nuance recently introduced vsearch - a voice search application. Similar to Vlingo's recent application on the blackberry.


The official video from Nuance







I believe the following video demonstrate better the hands free aspect of search.




Is it a gimmick or will people actually use it? What happens when there are speech recognition mistakes? Are there such mistakes? I like much more the unofficial video demonstrating the yahoo/vlingo voice search.



If someone has some statistics on voice base search, I will be glad to receive it.
Bookmark and Share