Shore '00: Student HCI Online Research Experiments

University of Maryland

Abstract
Introduction
Experiment
Results
Discussion
Conclusions

Acknowledgements
References
Appendices
Credits
Feedback

Back To Main

The Effect of Direct Annotation on Speed and Satisfaction

Results

Time Completion Result

The result of our experiment showed that the textbox method had the fastest average completion time of 100 seconds, the direct annotation method had the second average completion time of 107 seconds, and the click & type came last with the average completion time of 127 seconds (refer to the figure 1.1 and 1.2 on “Mean Completion Time”). The time was measured such that the computer started counting the time as a subject began their experiment until a subject finished each method. Thus the completion time implies how fast the method is done. The standard deviation for the direct annotation method was 24 seconds, the click & type method was 47 seconds, and the text box method was 35 seconds (refer to the figure 1.2 on “Standard Deviation of Total Completion Time”). On the extreme side, the fastest completion time with the direct annotation method was 81 seconds and the slowest completion time was 178 seconds. For the click & type method, the fastest was 80 seconds and the slowest was 237 seconds. For the text box method, the fastest was 62 seconds and the slowest was 191 seconds.


Figure 1.1



Completion Time (in seconds)

Direct Annotation Click and Type Text Box
Mean 107.1 130.2 100.5
Standard Deviation 24.0 46.6 35.5
Figure 1.2


ANOVA table for Completion Time

df Sum of Sq. Mean Sq. f
Treatments 2 18774.9 9387.4 2.1
Error 141 632712.1 4487.3
Total 143 651487.0

Figure 1.3


Subjective Satisfaction Result

For the subjective satisfaction the each of three methods was rate on the scale of 1 to 9; the 1 being the lowest subjective satisfaction with 9 being the highest subjective satisfaction. The direct annotation method had the highest average rating of 6.8, the click & type method with the second highest average rating of 5.2, and the text box at the last with the average rating of 4.2 (refer to the figure 2.1 and 2.2 on “Mean Subjective Preference”). The standard deviation for the direct annotation method was 1.8, the click & type method was 2.3, and the text box method was 2.2 (refer to the figure 2.2 on “Standard Deviation of Subjective Preference”). On the extreme side, the highest rating given to each of the three methods was 9 for each of them. For the lowest rating given for the three methods, the direct annotation method was given 3; for the click & type method and text box method, they were given 1 as the lowest rating.


Figure 2.1



Subjective Preference

Direct Annotation Click and Type Text Box
Mean 6.8 5.2 4.2
Standard Deviation 1.8 2.3 2.2
Figure 2.2


ANOVA table for Subjective Preference

df Sum of Sq. Mean Sq. f
Treatments 2 173.8 86.9 6.7
Error 141 1835.6 13.0
Total 143 2009.4

Figure 2.3


Background Survey Result

Of the 48 subjects participated, 12 were female and 36 were male.

The response to the background survey had two questionnaires to rate a subject; the first questionnaire asked how often a subject used a computer and the second questionnaire asked about familiarity with using the Window’s interface. These questionnaires are rated from 1 to 9. For the first questionnaire, 1 means less usage of a computer and 9 means very high usage of a computer. For the second questionnaire, 1 means less familiarity with Window’s interface and 9 means high familiarity with Window’s interface. The average response to the first questionnaire was 7.4; the average response to the second questionnaire was 6.7 (refer to the figure 3.1 on “Mean Subject Background”). The standard deviation for the first questionnaire was 1.0 while the standard deviation for the second questionnaire was 1.5 (refer to the figure 3.1 on “Standard Deviation of Subject Background”). On the extreme side, the highest response for both questionnaires was 9 for each of them. For the lowest response for the first questionnaire it was 6; for the second questionnaire it was 1.


Background Survey

Computer Usage Windows' Interface Familiarity
Mean 7.4 6.4
Standard Deviation 1.0 1.5
Figure 3.1


Department of Computer Sciences: Direct questions and comments to the student editorial team

University of Maryland