Human - machine interactive interface - VoiceXML


The scope of this project was for the student to manage to implement an interactive vocal server, which will be able to provide information to the users, guiding them through the process and responding to their demands, concerning a product (software, computer application, etc.)

For detailed information on this project see here on my Google drive.

In order to interact with the following sample application, call this number:  +990009369990065259 through Skype call (don't worry it's free).


How to test your own VXML applications

Set up  an account at Voxeo.com
In Account tab go to files, logs and reports and select the www  link. There you can upload and edit your application files.
In Account tab go to Application Manager and configure your application settings. You can now test your application by getting an international number. The call can be easily (and free) made via Skype call service.

VoiceXML

VoiceXML (VXML), which stands for Voice Extensible Markup Language is designed for creating audio dialogs that feature synthesized speech, digitized audio, recognition of spoken speech and DTMF key input, recording of spoken input, telephony, and mixed initiative conversations. Its major goal is to bring the advantages of Web-based development and content delivery to interactive voice response applications.

VoiceXML applications allow to:

• Send vocal prompts, messages an other audio materials to users
• Accept numeric input from users (phone DTMF)
• Accept voice input and recognize the words
• Record user voice input
• Sending user collected input to an internet server
• Retrieve data from a server and return it to the user


HMI application

As application I chose to implement an information service about a website.
It is an existing go-to website, called USEUM that concerns modern art. In this web platform, social network (crowd-sourced) artists and users can upload, comment, rate and follow works of art. The information service, will help this start-up to expand, providing the technological features of an HMI and therefore can be useful in many ways. The VoiceXML application is designed with simplicity, in order to allow users to learn more about this project without any difficulties.

System vocabulary

Vocabulary consists of the system prompts and the options available a user can have to interact with the system. These options are a number of words the system has defined and they can produce some output.

  • USEUM: general information about the start-up
  • Project: information about the project and how it works
  • World: popularity of the project around the globe
  • Social-media: links to social-media platforms
  • Contributors: information about artists and user
  • Mechanics: information on the website principles
  • Gift-shop: the on-line store of the platform

Human-machine interaction dialogue examples

Example 1

M (machine): Welcome to the interactive information service of USEUM. Here you can find information concerning USEUM project. We will guide you through the process to make sure you will be well informed. You can select to know more on the followings topics. Please repeat one of them after this message.
Choices are: USEUM, Project, World, Social media, Contributors, Mechanics, Giftshop.

H (human): Contributors

M (machine): Contributors ... (system prompts information about contributors)
Example 2

Welcome to the interactive information service of USEUM. Here you can find information concerning USEUM project. We will guide you through the process to make sure you will be well informed. You can select to know more on the followings topics. Please repeat one of them after this message.
Choices are: USEUM, Project, World, Social media, Contributors, Mechanics, Giftshop.

H (human): blablabla (user says something incomprehensible)

M (machine): We did not recognize what you said. Please try again.

M (machine): Welcome to the intera.. (user interrupts system prompt)

H: Gift-shop

M: The gift-shop is .... (system prompts information about the gift-shop)

Example 3

M (machine): Welcome to the interactive information service of USEUM. Here you can find information concerning USEUM project. We will guide you through the process to make sure you will be well informed. You can select to know more on the followings topics. Please repeat one of them after this message.
Choices are: USEUM, Project, World, Social media, Contributors, Mechanics, Giftshop.

H (human): user remains silent..

M (machine): We were not able to hear you. Please try again this time a bit louder.

M (machine): Welcome to the intera.. (user interrupts system prompt)

H: Project

M: The USEUM project is .... (system prompts information about the project)


VoiceXML application example

<vxml xmlns="http://www.w3.org/2001/vxml" version="2.1">
<form id="MainMenu">

<field name="info">
    <prompt>Welcome to the interactive information service of Uzium. Here you can find information concerning Uzium project. We will guide you through the process to make sure you will be well informed. You can select to know more on the followings topics. Please repeat one of them after this message. Choises are: Uzium, World, Socialmedia, Contributors, Mechanics, Giftshop.
    </prompt>

<!-- APPLICATION INTERNAL GRAMMAR -->
    <grammar mode="voice" xml:lang="en-us" root="myrule">
        <rule id="myrule">
            <one-of>
                <item>Uzium</item>
                <item>World</item>
                <item>Socialmedia</item>
                <item>Contributors</item>
                <item>Giftshop</item>
            </one-of>
        </rule>
    </grammar>

<!-- USER REMAINS SILENT -->
    <noinput>We were not able to hear you.Please try again this time a bit louder!<reprompt/></noinput>

<!--USER SAYS SOMETHING THAT IS NOT RECOGNIZED BY THE SYSTEM-->
    <nomatch>We did not recognize what you said. Please try again.<reprompt/></nomatch>

</field>

<!--AFTER CHECKING THE "INFO" VALUE IT WILL PROMPT A MESSAGE-->

<filled namelist="info">
    <if cond="info == 'Uzium'">
        <prompt>Uzium is a start-up company and a go-to website concerning the field of modern arts. More than that, it is a crowd-source platform that aims to collect and display modern artworks and of-course provide the artists a chance to augment their audience.
        </prompt>

    <elseif cond="info == 'World'"/>

        <prompt>Uzium is now participating and covering artists allong with their works around the globe in all different continents and many distant countries. The distance between the artist and the audience is shortened.
        </prompt>

    <elseif cond="info == 'Socialmedia'"/>

        <prompt>Uzium uses social media in order to expand. Besides media like twitter facebook etc, the website of Uzium have social aspects. You can find more information in Uzium homepage at Uzium dot kom. Just gougle it.
        </prompt>

    <elseif cond="info == 'Contributors'"/>

        <prompt>The contributors of this project is you people. Artists, followers, moderators and simple users are the living aisence of this platform. The [rpject without them would be unuseful and not worth developing. Continue to share your works and do not be afraid to comment.
        </prompt>

    <elseif cond="info == 'Mechanics'"/>

        <prompt>This site mechanics are simple. As long as someone is active by either uploading works, commenting on someone elses work, making correlations between different artists and works, it will be rewarded with some points that will be later on be able to use them in his profit.
        </prompt>

    <elseif cond="info == 'Giftshop'"/>

        <prompt>The giftshop area is where the artists can finally gain some profit and for the audience it is the place of happiness. With a variety of items bariing artworks this corner has to be visited more than once.Feel free to explore and do not hesitate to reward someone if you liked his work.
        </prompt>

    <else/>

        <prompt>A match has occured but we were not able to identify it.Probably it was not important.</prompt>

    </if>

</filled>

</form>
</vxml>

No comments:

Post a Comment


Free online chess

View Kapellas Nick's profile on LinkedIn
Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License