SHORE 2001 Logo
SHORE 2001 Logo University of Maryland Logo
Student HCI Online Research Experiments
Abstract
Introduction
Experiment
Results
Discussion
Conclusions
Acknowledgements
References
Appendices
Credits
Feedback
SHORE 2001 : Handheld Devices : A Comparison of Grafitti vs. the On-Screen Keyboard for Experienced Palm Users

Acknowledgements

We would like to thank Dr. Ben Shneiderman for his continuous help throughout the semester pertaining to our project. We would like to thank Patrick Callis for writing the Palm Pilot program that we used to test our subjects. We would also like to thank Rob Sherwood and Richesh Ruchir for their help in seeking subjects.

References

We utilized the following sources conducting this experiment and composing this writeup.

1. The Immediate Usability of Graffiti, 1997. May 2, 2001.
http://www.yorku.ca/mack/GI97a.html

2. PDA and Gesture Use in Practice, May 2, 2001.
http://bmrc.berkeley.edu/research/publications/1997/142/clong.html

3. A Comparison of Four Methods of Numeric Entry on Pen-based Computers, 1994.
May 2, 2001. www.yorku.ca/mack/gi94.html

4. CHI '95 Home Page, 1995. May 2, 2001.
http://www.acm.org/sigchi/chi95/electronic/documents/papers/crf_bdy.htm

5. Proposal for an Experimental Usability Test for the 3Com Palm Pilot, 1999.
May 2, 2001. http://fortes.com/business/portfolio/hci/palmexperiment.pdf

6. Mobile Text Input, May 2, 2001.
http://www.daimi.au.dk/~ehlers/pda/mobiletextinput.pdf

7. Existing Text Input Methods, May 2, 2001.
http://www.cs.uta.fi/~poika/g/node6.html

8. Quikwriting, May 2, 2001.
http://www.mrl.nyu.edu/perlin/demos/quikwriting.html

9. ACM: The first society in computing. May 2, 2001.
www.acm.org/sgichi/chi97/proceedings/paper/fkm.htm

10. How to enter data into a Palm Handheld, May 2, 2001.
www.palm.com/products/input

11. Shneiderman, Ben. Designing the User Interface (3rd Ed.).
1998, Addison Wesley Longman, Inc.

Appendices

Appendix A.1 Instructions to subjects

"This experiment tests two different input methods for a Palm Pilot - onscreen keyboard and graffiti. You will enter an address into multiple fields. It is very important that once you start entering the data, you complete each task without interruption. You can either correct your errors as you go along or at the end. The program will not terminate unless the input matches the correct input. Thus, accuracy is very important.

In the first part, you will enter the information into the memo field and then into the multiple address fields. Please inform the experimenter when you are done with each task so that the time can be recorded. In the second part of the experiment, you will repeat the two tasks using an alternate input method"

Appendix A.2.1 Input Data 1

Please note, this is an HTML representation af the document used for testing.

Please enter the following characters first using the onscreen keyboard and then using Graffiti.

Practice Sentence: abcdefghijklmnoqrstuvwxyz1234567890,.


Part 1 - ONSCREEN KEYBOARD

Task 1 - Input the following into the LARGE MEMO FIELD (66 characters)

After problems with Pilot pen factory, the name of the PDA changed.


Task 2 - Input the following into 3 separate ADDRESS FIELDS

Name- John Smith
Address- 2704 College Park Rd, Terptown, AZ, 50412
Telephone- 502-672-8953


Part 2 - GRAFFITI

Task 1 - Input the following into a LARGE MEMO FIELD (66 characters)

In 1996 US Robotics introduced the Pilot 1000 PDA pocket computer.


Task 2 - Input the following into 3 separate ADDRESS FIELDS

Name- Carl Allen
Address- 4975 Burrows Pond Ln, Chestnut, NH, 75915
Telephone- 359-923-8671

 

Appendix A.2.2 Input Data 2

Please note, this is an HTML representation a the document used for testing.

Please enter the following characters first using the onscreen keyboard and then using Graffiti.

Practice Sentence: abcdefghijklmnoqrstuvwxyz1234567890,.


Part 1 - GRAFFITI

Task 1 - Input the following into the LARGE MEMO FIELD (66 characters)

After problems with Pilot pen factory, the name of the PDA changed.


Task 2
- Input the following into 3 separate ADDRESS FIELDS

Name- John Smith
Address- 2704 College Park Rd, Terptown, AZ, 50412
Telephone- 502-672-8953


Part 2 - ONSCREEN KEYBOARD

Task 1 - Input the following into a LARGE MEMO FIELD (66 characters)

In 1996 US Robotics introduced the Pilot 1000 PDA pocket computer.


Task 2 - Input the following into 3 separate ADDRESS FIELDS

Name- Carl Allen
Address- 4975 Burrows Pond Ln, Chestnut, NH, 75915
Telephone- 359-923-8671


Appendix A.3 Satisfaction Survey

Please note, this is an HTML representation a the document used for testing.

Please Rate the following Statements:

1) I found Graffiti effective for the Memo Field Task

Agree     1     2     3      4     5     6     7    8    9    Disagree


2) I found Onscreen Keyboard effective for the Memo Field Task

Agree     1     2     3      4     5     6     7    8    9    Disagree


3) I found Graffiti effective for the Address Fields Task

Agree     1     2     3      4     5     6     7    8    9    Disagree


4) I found Onscreen Keyboard effective for the Address Field Task

Agree     1     2     3      4     5     6     7    8    9    Disagree


Additional Questions (Circle The Answer)

1) How long have you been using the Palm Pilot?

       1-2 Months    2-6Months    6-12Months

2) What is your primary method of input in?

      Onscreen    Keyboard Graffiti

 

Please write any comments you may wish to add to the back of this form.

Appendix B Raw Data

Key:
K/M = Keyboard entry on memo field
K/A = Keyboard entry on address field
G/M = Graffiti entry on memo field
G/A = Graffiti entry on address field

Appendix C Statisitcs

Appendix D

This is an example of the experimental consent form used

Experimental Consent Agreement

1. I have freely volunteered to participate in this experiment.

2. I have been informed in advance as to what my task(s) woudl be and what procedures woudl be followed.

3. I have been given the opportunity to ask questions, and have had my questions answered to my satisfaction.

4. I am aware that I have the right to withdraw consent and discontinue participation at any time, without prejudice.

5. My signature below may be taken as affirmation of all of the above, prior to participation

Name
Student ID
Phone #
 
 

Here are some screenshots of our Palm Pilot Test Program

Credits

Daniel Giambalvo

  • Pilot testing
  • Introduction
  • Experiment
  • Conclusion
  • Running of test subjects
  • Webpage coordination
  • Editing

Ann Frolov

  • Computation of Statistics
  • Results
  • Discussion
  • Abstract
  • Running of test subjects
  • Pics for web
  • Editing

Navid Norouzi

  • Proposal
  • Pilot testing
  • Running of test subjects
  • Screen shots of Palm
  • Palm timing program
  • Testing of Subjects
  • Composition of Acknowledgements, References, Appendices