Authors

Eiman M. Elnahrawy (eiman@cs.umd.edu)

Nagia M. Ghanem (ghanem@cfar.umd.edu)

Moustafa A. Youssef (moustafa@cs.umd.edu)  

Acknowledgements

We would like to thank the following people for their help throughout the experiment:

We would like to thank Dr. Ben Shneiderman for his encouragement, guidance, and insightful comments.

We are grateful to Dr. Doug Oard for his technical support and guidance throughout the experiment.

A special thanks is due to Clara Cabezas for her sincere help and guidance.

Thanks to Gina Levow for her guidance.

We would also like to thank our pilot subjects, who provided helpful comments and suggestions.

Lastly, our sincere thanks to the subjects who graciously agreed to take part in this study.

[Top]

References

1.    William Ogden, James Cowie, Mark Davis, Eugene Ludovik, Sergei Nirenburg, Hugo Molina-Salgado, and Nigel Sharples. Keizai: An Interactive Cross-Language Text Retrieval System. Computing Research Lab, New Mexico State University.

http://crl.nmsu.edu/~ogden/Papers/MTsummit.pdf

(Accessed May 1st, 2001)

2. William Ogden, James Cowie, Mark Davis, Eugene Ludovik, Hugo Molina-Salgado, and Hyopil Shin. Getting Information from Documents You Cannot Read: An Interactive Cross-Language Text Retrieval and Summarization System. Computing Research Lab, New Mexico State University.

http://www.clis.umd.edu/conferences/midas/papers/ogden.pdf

(Accessed May 1st, 2001)

3. Douglas W. Oard, Ginna-Anne Levow, and Clara I. Cabezas. TREC-9 Experiment at Maryland: Interactive CLIR. November 2000.

http://www.clis.umd.edu/dlrg/filter/papers/trec9.ps

(Accessed May 1st, 2001)

4. Mark W. Davis and William C. Ogden. Implementing Cross-Language Text Retrieval systems for Large-scale Text Collections and the World Wide Web. Proceedings of the AAAI Workshop on Cross-language Text Retrieval. Stanford University, Palo Alto, California.

http://crl.NMSU.Edu/Research/Projects/tipster/ursa/Papers/PDF/aaai-davis-2.pdf

(Accessed May 1st, 2001)

5. Marti A. Hearst. User interfaces and visualization. In Ricardo Baeza-Yates and Berthier Ribeiro-Neto, editors, Modern Information Retrieval, chapter 10. Addison Wesley, New York, 1999.

6. Douglas W. Oard. Evaluating Interactive Cross-Language Information Retrieval: Document Selection. In Proceedings of the first Cross Language Evaluation Forum, September 2000.

http://www.clis.umd.edu/dlrg/filter/papers/clef2.ps

(Accessed May 1st, 2001)

7.   David Eichmann, Miguel E. Ruiz, and Padmini Srinivasan. Cross-Language Information Retrieval with the UMLS Metathesaurus. SIGIR’98, 1998.

http://www.cs.mu.oz.au/sigir98/abstracts/eichmann.html

(Accessed May 1st, 2001)

8.  Philip Resnik, Evaluating Multilingual Gisting of Web pages. In AAAI Symposium on Natural Language Processing for the World Wide Web, Stanford, CA, March 1997.

http://umiacs.umd.edu/~resnik/papers/gisting_eval.ps.gz

(Accessed May 1st, 2001)

9. The University of Maryland Translingual Information Retrieval System.

http://nlp.umiacs.umd.edu:8080/CPD_demo/Welcome.html

(Accessed May 1st, 2001)

10. Bob Bailey, Insights from Human Factors International, UI Design Update Newsletter – April, 1999

 http://www.humanfactors.com/library/apr99.asp

(Accessed May 1st, 2001)

11.  Ross Wilkinson, Evaluation, Position talk in ACM SIGIR'99 Workshop on Customized Information Delivery August 19, 1999 - Berkeley, California.

http://www.ted.cmis.csiro.au/sigir99/wilkinson/

(Accessed May 1st, 2001)

[Top]

Appendices

A. Experimental Materials

• Subject consent form.
• Background Questionnaire.
• Instructions.
• Experiment Web Site.
• Screen Snapshots:
• Two Translations per word.
• Three Translations per word.
• Four Translations per word.
• Subjective Satisfaction Survey.

B. Raw Data

• Results.
• ANOVA.

[Top]

Credits

·        Shared Work:

o       Designing the experiment and reviewing all reports.

o       Preparing the project proposal.

o       Running the pilot study.

o       Running the experiment.

·        Eiman M. Elnahrawy:

o       Prepared and wrote the Questionnaire and Subjective Satisfaction forms.

o       Prepared and wrote the references report with Nagia.

o       Prepared the statistics and fake data.

o       Collected the raw data from the Questionnaire and subjective satisfaction survey and performed the statistical analysis for the actual data.

o       Prepared the raw data report with Nagia.

o       Wrote the experiment and results sections in the final report.

·        Nagia M. Ghanem:

o       Prepared the user’s instruction form.

o    Prepared the task list.

o       Prepared and wrote the references report with Eiman.

o       Prepared the raw data report with Eiman.

o       Prepared the abstract and introduction.

o       Wrote a program to calculate the recall and precision from the raw data.

o       Wrote the abstract, introduction, references, and appendices sections in the final report.

·        Moustafa A. Youssef:

o       Updated and ran the scripts for cleaning, translation, and indexing the original corpus.

o       Wrote a script to provide each user with a different query for each treatment.

o       Prepared the Web site that the users used during the experiment.

o       Wrote a script to collect the user input in a raw data file.

o       Wrote the discussion and conclusions sections.

o       Assembled the experiment site for the SHORE 2001.

[Top]

Feedback

Moustafa A. Youssef (moustafa@cs.umd.edu)

Nagia M. Ghanem (ghanem@cfar.umd.edu)

Eiman M. Elnahrawy (eiman@cs.umd.edu)

[Top]