How can I get voice recognition features into the Unity Game Engine? Is there a plug-in or a framework (hopefully freeware) that I could use? If so, do you have any ideas on how to install it? Also, how much of a problem would there be with background noises in the game interfering with the voice inputs into the game? Are there any examples of games on the market that use this? (besides for Spain 3D for the Torque Game Engine).
-
\$\begingroup\$ All FOSS free-text transcription systems are generally terrible. Almost certainly not worth the effort it will take unless you are willing to shell out $$$$$ to work with someone like Nuance. \$\endgroup\$coderanger– coderanger2011-03-29 20:13:39 +00:00Commented Mar 29, 2011 at 20:13
-
\$\begingroup\$ @coderanger: Free-text transcription is hardly the only use of voice recognition, and probably least likely to be necessary in games. \$\endgroup\$user744– user7442011-03-29 20:34:11 +00:00Commented Mar 29, 2011 at 20:34
-
1\$\begingroup\$ Sure, but if you know enough about speech recognition to build your own language model, you probably wouldn't be asking on here :-) \$\endgroup\$coderanger– coderanger2011-03-29 22:42:55 +00:00Commented Mar 29, 2011 at 22:42
-
\$\begingroup\$ This may have been closed, but the answers could be misleading as of Unity 5.4. If you're targeting windows alone, you can make use of the UnityEngine.Windows.Speech namespace. KeywordRecogniser and DictationRecogniser are the two classes of interest. \$\endgroup\$zcabjro– zcabjro2016-11-10 09:41:22 +00:00Commented Nov 10, 2016 at 9:41
2 Answers
Unity3D doesn't have any direct support for voice recognition. You would need to write an extension (System.Speech.Recognition) or find some kind of plug-in to get you rolling. If you do end up going this direction you will lose out on the unity web player compatibility with your project.
I do not see any plug-ins that are already developed for this purpose.
-
5\$\begingroup\$ And this will be HARD : codinghorror.com/blog/2010/06/… \$\endgroup\$Jesse Dorsey– Jesse Dorsey2010-08-04 02:27:52 +00:00Commented Aug 4, 2010 at 2:27
-
\$\begingroup\$ Yeah, that is no joke. \$\endgroup\$David McGraw– David McGraw2010-08-04 03:52:28 +00:00Commented Aug 4, 2010 at 3:52
Community Core Audio is looking pretty promising. It converts voice to text and is said to handle automatic speech recognition. The data is sent via the network through UDP so it would be easy to integrate into Unity. That is if you're not planning on using the webplayer.