Open Sesame

From Madwiki

Description

Open Sesame is an interactive Spoken Dialog System that allows an operator to create multimedia touchscreen and speech driven applications for educational and training purposes. Resulting applications are accessible regardless of literacy level, computer savvy, or native language of end users. Open Sesame includes two example applications. The first is a demonstration in the Tamil language of agricultural techniques for growing banana crops. The second, also in Tamil, is a demonstration of drip irrigation methods.

Photos from our fieldwork in Tamil Nadu, India in 2005 and 2006. Custom hardware was developed for the field studies on voice (Phone-mic) and touch (Handmade Flex Buttons) interfaces to the dialog system in Tamil Nadu.

Status

Version 1.0 is being tested in village centers in Southern India. The tool is Open Source, but requires Dictionary Maker and HTK to operate.

Tamil Nadu, 2006: Brittoo demonstrates how to use Open Sesame to access locally relevant, agricultural information using voice or touch.

Project Team

• Richard Carlson
• Udhaykumar Nallasamy
• Madelaine Plauché

Collaborators

• Madhu Prabaker
• Divya Ramachandran
• Joyojeet Pal
• Ozgür Çetin
• M. S. Swaminathan Research Foundation
• Jahanzeb Sherwani

See related Publications.