Appendices

Metaphors: Realistic vs. Form-based Phone Interfaces

Appendices

Appendix A - Informed Consent Form

This is to certify that I hereby agree to participate as a volunteer in a scientific experiment as an authorized part of the education and research program of the Department of Computer Science, College Park, under supervision of Christopher Malter, Michael Moyer, Brian Renn, or David Siegel, the researchers.

I have been given an opportunity to ask any questions I may have had regarding this experiment, and all such questions and inquiries have been answered to my satisfaction. I understand that I am free to deny any answers to specific items or questions in interviews or questionnaires. I understand that any data or answers to questions will remain confidential with regard to my identity.

I have had the experiment explained to me and understand that the purpose of this experiment is to investigate speed of response in programs designed with "real world" metaphorical designs as opposed to standard Windows designs.

I further understand that I am free to withdraw my consent and terminate my participation at any time.

Appendix B - Instructions

You will be given a series of two tests. Each test will present you with a series of tasks and a program to perform the tasks on.

Instructions for completing each task will be displayed in the upper left-hand corner. Read the instructions VERY CAREFULLY before performing each task. We will be testing how long it takes you to perform each of the tasks.

When you are finished with a task, the program will automatically move on to the next task in the series.

When you have finished all of the tasks, the program will pop up a dialog box that tells you that you are done.

Press the button below to proceed with test 1.

Appendix C - Background Survey

bgsurvey.gif (16305 bytes)

Appendix D - Task List

Our first two tests will involve dialing a number and then clearing the display. The display can be cleared by either pressing the 'Flash' button or closing an opened line. Dial the number '12345' and then clear the display.
Lets try clearing the display again. Dial '67890' and clear the display.
The next two tests will involve calling somebody on campus. Open a line and call your friend Bob at 5-4321.
After calling Bob, you suddenly got hungry. You remember that your friend Suzie just got out of class. Open a line and call her at 5-6293.
You decided to go to Bennigans to get some food. Now you want to check your voicemail. Open a line and dial 314-4316 to check your mail.
While you were at Bennigans, you got a call from a professor. You don't want to wait until you get home before you call him back. Open a line and dial 405-3258 to call back your prof.
While you were talking to your professor, you suddenly remembered that you were supposed to call your Aunt Mary. Today is her birthday. You don't think you'll get home before she usually goes to bed, so you decide to call her from the restaurant. Open a line and call her at 434-4193.
Whoops, you just remembered that Aunt Mary moved last summer and you don't know her new number. Open a line and call your mother at 394-3761 to get Aunt Mary's number.
When you get home, you want to add Aunt Mary's phone number to your frequent call list. There is a button on the bottom of the phone that opens the frequent call panel. Open the panel and add the following entry to the list: Name='Aunt Mary', Number='1983648' (don't use any dashes or spaces when entering the number)
Now that you've added the entry to your frequent dial list, you realize that you really want to add Aunt Mary to your speed dial. Open the frequent call panel and add Aunt Mary to your speed dial. Then open a line and call Aunt Mary by using speed dial.
Its several hours later now and you realize that you're hungry. You go to dial Papa John's to get a pizza when you realize that you eat a lot of pizza and you should add Papas to your frequent call list. Open the frequent call panel and add the following entry to your list: Name='Papa Johns', Number='2777722' (don't use any dashes or spaces when entering the number)
You have now added Papa John's phone number to your frequent caller list. "On second thought", you think, you want to add Papa's to your speed dial. Open your frequent call list, add Papa's to your speed dial, then open a line and call Papa John's using speed dial.

Appendix E - Visual Basic Test Tool Screens


RealPhone Test	Form-based Test

Appendix F - Subjective Satisfaction Questionnaire

qsurvey.gif (18065 bytes)

Appendix G - Comparison Survey

endsurvey.gif (10898 bytes)

Appendix H - RealPhone Test Raw Data

Subject	Task 1	Task 2	Task 3	Task 4	Task 5	Task 6	Task 7	Task 8	Task 9	Task 10	Task 11	Task 12
1	33.5	13.4	172.3	9.4	14.6	12.5	12.7	12.5	34.7	78.8	16.3	26.3
2	5	6.5	36.1	6.9	6.6	6.9	5.7	10.4	30.4	12.6	11.9	7.5
3	15	7.7	57.7	11.8	15.2	10.6	8	9.9	22	22.7	20.9	6.2
4	8.4	18.3	6.1	5.2	5.6	17	9.3	7.3	29.3	6.5	12.3	5.3
5	20.9	9.2	122.4	7.6	46.7	6.9	6.5	7.9	14.8	12	11.9	5.5
6	8.1	4.5	65.3	5.9	16.8	16	8.6	8.6	40.2	15.7	14.1	9.3
7	9.8	14.1	43.5	5.6	18.3	7.4	7.8	7.6	21.3	23.5	16.7	10.5
8	15.7	7.5	50.7	8.6	9.6	10	7.7	10.3	32.4	29.5	26.2	9.9
9	7	4.3	16	4.4	6.3	6.6	5.6	7.8	22.1	10.4	14.9	5.4
10	13.6	10.5	6.9	12.9	83.1	12.9	7.5	12.7	32.8	25.4	22.5	9.9
11	4.9	37.6	49.2	14.4	9.4	9.1	6	11.1	21.4	35.8	16	22.9
12	7.2	7.3	8.6	5.1	8.8	15.9	11.2	20.9	22.6	8.2	13.3	6.3
13	13.9	6.6	10.3	9.1	12.9	13.1	12.9	15.5	25.5	13.2	15.7	28.1
14	16.9	13.2	10.5	10.3	11.7	24.2	11.9	10.5	18.7	8.2	11.8	7.8
15	13.6	23.3	4.2	4.7	6.7	7.1	5.7	6.8	13.4	6.3	10.4	5
16	4.6	4.6	5.1	9	7.5	6.7	6.9	8.4	17.4	5.9	10.5	4.2
17	8.3	4.6	12.6	6.2	9.9	9.5	7.4	9.8	20	8.6	12.5	5.1
18	15.6	9.2	4.5	6	5.9	8.1	7.7	7.2	17.5	7.8	14.2	7.1
19	6.1	5.1	4.9	25.9	15.6	20	6.7	7.7	13.6	11	14.1	5.7
20	20.1	9.8	9.6	7.9	9.4	15.7	9.1	9.4	22.8	7	15.2	4.9
21	15	6.4	41.3	2.8	2.8	9.2	4.3	6.4	9.2	4.7	10	11.5
22	7.5	4.5	8.6	4.7	7.1	8.2	20.9	13.4	12.8	5	13	5.2

Note: Yellow cells indicate times greater than one minute. These values were capped to sixty seconds when we tabulated our results.

Appendix I - Form-based Phone Test Raw Data

Subject	Task 1	Task 2	Task 3	Task 4	Task 5	Task 6	Task 7	Task 8	Task 9	Task 10	Task 11	Task 12
1	11.8	10.8	14.9	13.2	8.8	9.7	6.8	10.2	20.6	50.4	18.5	23.5
2	8.4	6.7	7.4	4.6	6.8	6.3	6.2	9.5	14.4	10	11.7	7.2
3	18	5.8	8.6	7	10.1	9.5	30.8	10.8	14.8	9	10.5	11.8
4	7.6	8.3	4.1	4.9	9.7	9.8	6.4	7.7	13.2	5.9	13.6	5.5
5	10.6	5.9	4.4	5.6	6.4	5.9	6.3	8	17.7	6.6	11.3	4.1
6	12.3	4.7	18.6	7.1	10.5	7.5	6.8	8.1	17.5	11.1	16.7	8
7	13.5	6	5.4	6.4	7.2	7.3	15.5	8.2	16.3	10.1	17	6
8	9.7	9.2	9.4	8.5	13.4	10.3	11.9	13.3	34.6	9	19.2	10.5
9	5.6	3.9	4	5.3	6.2	6.4	5.6	9.2	16.5	6.7	13	4.9
10	14	6.7	11.3	6.4	8.6	6.7	9.6	8.3	14.6	11.4	19	8.7
11	15	9.1	5.3	6.2	6.9	7	23	8.6	16.2	15.5	15.9	9.7
12	12.1	38.6	8.5	7.7	11.7	12	9.3	11.3	30.5	15.5	16.9	7.3
13	244.4	11.5	86	8.7	12	9.4	8.9	13.2	34	50.4	26.1	12.2
14	107.4	18.4	32.4	11.3	25	10.3	10	11.8	28.4	13.9	16.3	6.8
15	8.2	8.3	8.1	4.2	5.9	6.6	6.2	7.2	71.5	15.8	13.4	5.5
16	5.8	5.9	5.4	35.9	8.8	6.8	5.6	6.3	17.9	6.2	13.1	5.2
17	9.7	25.9	75.1	27.9	16.5	23.2	10.1	10.8	19	6.2	112.7	10.6
18	11.6	17.4	6	5.1	15.8	10.1	10.4	67.2	19.8	33.9	12.3	7.3
19	5.1	5.6	14	5.6	6.2	6.7	6.8	6.5	19.2	22.1	15.4	5.8
20	11.3	4.6	44.2	6.4	12	8.2	10.8	11.6	21	21.3	21.9	11.6
21	6.2	6.4	11.1	7	19.9	9.9	4.8	5.2	12.3	5.9	10.6	5.7
22	9.6	4.3	76.3	7.3	5.6	7	7.2	8.6	15.3	11	16.6	4.9

Note: Yellow cells indicate times greater than one minute. These values were capped to sixty seconds when we tabulated our results.

Appendix J - RealPhone Questionnaire Raw Data

Subject	Overall	Confusing	Attractive	Distracting
1	5	1	5	5
2	7	5	8	8
3	6	6	7	9
4	7	8	9	9
5	8	7	9	9
6	3	6	3	5
7	7	8	9	8
8	6	5	4	2
9	7	6	9	9
10	3	4	7	2
11	5	7	5	5
12	9	9	9	9
13	8	8	5	8
14	8	8	8	8
15	7	6	8	9
16	5	6	9	8
17	7	9	7	9
18	8	8	9	9
19	7	7	8	9
20	6	7	9	9
21	7	4	8	8
22	6	4	6	6

Appendix K - Form-based Phone Questionnaire Raw Data

Subject	Overall	Confusing	Attractive	Distracting
1	5	1	5	5
2	7	7	7	8
3	6	6	5	9
4	5	6	8	5
5	8	8	9	9
6	7	6	7	9
7	6	6	5	7
8	8	8	8	7
9	9	9	1	7
10	7	8	6	9
11	3	4	4	5
12	9	9	4	9
13	9	9	7	9
14	7	7	5	8
15	5	6	3	9
16	7	7	6	7
17	7	9	2	4
18	6	8	8	8
19	8	8	6	8
20	6	9	3	8
21	7	8	8	8
22	4	4	4	4

Appendix L - Comparison Survey Raw Data

Subject	Visually Appealing	Easier to Use	Would Rather Buy
1	R	F	F
2	R	F	F
3	R	R	R
4	R	R	R
5	R	F	F
6	F	F	F
7	R	R	R
8	F	F	F
9	R	F	R
10	F	F	F
11	R	R	R
12	F	F	F
13	R	R	R
14	R	F	R
15	R	F	F
16	R	F	R
17	R	F	R
18	R	F	R
19	R	F	F
20	R	F	F
21	R	R	R
22	R	F	R

Appendix M - File/Software Downloads

$After downloading, unzip to c:\temp, load the project file using VB6, run the project from VB6.$	Visual Basic Test Tool
	Final Written Report
	PowerPoint Presentation

Department of Computer Sciences
Direct questions and comments to the student editorial team