Shore '00: Student HCI Online Research Experiments

University of Maryland

Abstract
Introduction
Experiment
Results
Discussion
Conclusions

Acknowledgements
References
Appendices
Credits
Feedback

Back To Main

Comparison of Telephone Menu Interfaces

Results

Statistical Data

Average Performance Times

avgruntime.jpg (22698 bytes)

Chart 1.1

This chart shows the average performance times for both system, Shoutmail and Coolemail. The overall performance times shows no real statistical significance between the two systems. Surprisingly, Coolemail seems to have a performance preference with the female subjects.

User Satisfaction Ratings

The survey consisted of 6 questions. They all had a rating from 1 - 9, where the number was related to different opinions about the systems.

Phone Email system:
1 Frustrating (1) Satisfying (9)
2 Difficult (1) Easy (9)
3 Rigid (1) Flexible (9)
Finding the specified email:
4 Difficult (1) Easy (9)
5 Slow (1) Fast (9)
Understanding the email message:
6 Difficult (1) Easy (9)

malesat.jpg (30179 bytes)

Chart 1.2

femalesat.jpg (30096 bytes)

Chart 1.3

The survey revealed statistically significance for question 3, which relates to the systems phone menu. Both male and female subjects found Shoutmail’s phone menu system to be more flexible than Coolemail’s phone menu system. When looking at the menu system for Shoutmail, the differences are quite clear. Shoutmail offers more to the user than Coolemail. A quick sample scenario of a login at Shoutmail and Coolemail will look like this:

Shoutmail:

Female computerized voice:
"Press 1 for email; Press 2 for news; Press 3 for weather; Press 4 for financial news; Press 5 for sport; Press 6 for entertainment news;quot;.
"Click 0 at all times to repeat options".
1 selected:
"Press 1 to hear new messages; 2 to send a message; 3 to hear other message; 9 for more options".
1 selected:
"Press 1 to hear the message; 2 to reply; 3 for next; 4 to delete; 5 to store; or 9 for more options".


Coolemail:

Female computerized voice:
"Hello userID"
A commercial is played
"You have new messages for message center"
"press 1; to change personal options press 8"
(Options are repeated automatically)
1 selected:
(male voice speaking the message)
"Message from sender subject subject"
" Listen to this message press 1; Skip message press #; To delete message press 7"


This quick scenario shows the main features of the system, and how the menu system is designed with relations to hierarchical levels. Shoutmail has a more flexible system, which also offers more advanced features such as News and Weather. Shoutmail's menu system requires 3 levels of traversal to listen to a message, while Coolemail has less options, but requires only 2 levels of traversal.

Means and Standard Deviations





Above tables show the results of t-test analysis. The analysis was performed using Microsoft Excel 97. Click here for Raw Data in html or in Excel


Department of Computer Science: Direct questions and comments to the student editorial team

University of Maryland