Back to the list of appendicesAppendix 1 - Tasks
Appendix 2 - Pre Survey
Appendix 3 - Post Survey (for groups with Training)
Appendix 4 - Post Survey (for groups without Training)
Appendix 5 - Raw data on Time and Accuracy
Appendix 6 - Statistical Analysis (Browse with Training
v/s Search with Training)
Appendix 7 - Statistical Analysis (Browse without Training
v/s Search without Training)
Appendix 8 - Statistical Analysis (Browse with Training
v/s Browse without Training)
Appendix 9 - Statistical Analysis (Search with Training
v/s Search without Training)
Appendic 10 - Statistical Analysis (Browse or Search
with Training v/s Browse or Search without Training
1. During General Grant’s Wilderness campaign,
he attacked the Confederate forces at Cold Harbor, VA. Find the artist(s)
who compiled the photograph of the battlefield at Cold Harbor.
Answer: Hirst D. Milhollen and Donald H. Mugridge
Search: Easy
Browse: Easy
2. What was the purpose of the Emancipation
Proclamation issued on January 1, 1863?
Answer: To free 3 ½ million slaves
Search: Hard (under title "I saw the stars")
Browse: Easy
3. What was the date of the night
attack on Fort Sumter?
Answer: September 8, 1863
Search: Easy
Browse: Medium
4. The Civil War ended on
April 9, 1865, when General Robert E. Lee surrendered to Major General
Ulysses S. Grant. Where did the surrender take place?
Answer: Appomattox Courthouse
Search: Hard
Browse: Easy
5. In 1865, what woman was
hanged as a conspirator associated with the assassination of President
Lincoln? Answer: Mrs. Mary Surratt
Search: Hard
Browse: Hard
Back to the list of appendices
Informational Survey
This information will be used to structure the test groups and to contact
you about the experiment. It will be kept confidential.
Please tell us about you:
First Name: _________________Last Name: ______________
Gender: 0 Male 0 Female Phone Number: __________________E-mail: ______________
Briefly answer the following questions:
What subject areas of American history do you like best?
What subject areas of American history do you like least?
Check the relevant items:
1. Are you a history major?
0 Yes 0 No
2. Have you ever used the Netscape browser?
0 Yes 0 No
3. How often do you surf the Web per week?
0 Never (0) 0 Rarely (1-3) 0 Occasionally (4-6) 0 Often (7+)
4. When you surf the Web, do you primarily utilize the search engines
or do you browse by hot links to locate information?
0 Never (0) 0 Search 0 Browse 0 Both
5. How often are your Internet searches or browses successful or return
the expected results?
0 Never (0) 0 Rarely (1-3) 0 Occasionally (4-6) 0 Often (7+)
6. How often do you visit the Library of Congress in Washington, D.C.
per year?
0 Never 0 1-2 visits 0 Monthly 0 Weekly 0 Daily
7. How often do you use the Library of Congress American Memory Web
Site per year?
0 Never 0 1-2 visits 0 Monthly 0 Weekly 0 Daily
Back to the list of appendices
Appendix 3 - Post Survey (for groups with Training)
Post Survey
Please tell us about you:
First Name: ____________________ Last Name: _______________________
Briefly answer the following questions:
What did you like most about the Library of Congress American Memory
website?
What did you like least about the Library of Congress American Memory website?
What else did you learn about the Civil War or the American Memory website aside from the answers to the task questions?
Circle your answers using a scale from 1-9 where 1 is the lowest and 9 is the highest:
1. Was your training adequate to perform your assigned tasks?
1 2 3
4 5
6 7
8 9
2. How would you rate your overall ability to effectively complete the
assigned goals?
1 2 3
4 5
6 7
8 9
3. Would you consider using the Library of Congress American Memory
website in the future?
1 2 3
4 5
6 7
8 9
Back to the list of appendices
Appendix 4 - Post Survey (for groups without Training)
Post Survey
Please tell us about you:
First Name: ____________________ Last Name: _______________________
Briefly answer the following questions:
What did you like most about the Library of Congress American Memory
website?
What did you like least about the Library of Congress American Memory website?
What else did you learn about the Civil War or the American Memory website aside from the answers to the task questions?
Circle your answers using a scale from 1-9 where 1 is the lowest and 9 is the highest:
1. Would you have benefitted from a training session to perform your
assigned tasks?
1 2 3
4 5
6 7
8 9
2. How would you rate your overall ability to effectively complete the
assigned goals?
1 2 3
4 5
6 7
8 9
3. Would you consider using the Library of Congress American Memory
website in the future?
1 2 3
4 5
6 7
8 9
Back to the list of appendices
Appendix 5 - Raw Data on Time and Accuracy
The data listed shows time, accuracy (0=wrong;1=right) for three subjects in each category for 5 questions.
BROWSE - w/ TRAINING
| Q1 | Q2 | Q3 | Q4 | Q5 | |
| SUB1 | 86, 1 | 240, 1 | 102, 0 | 83, 1 | 112, 1 |
| SUB2 | 86, 0 | 99, 1 | 300, 0 | 176, 1 | 295, 1 |
| SUB3 | 249, 1 | 300, 0 | 300, 0 | 300, 0 | 288, 1 |
SEARCH - w/ TRAINING
| Q1 | Q2 | Q3 | Q4 | Q5 | |
| SUB1 | 300, 0 | 300, 0 | 64, 1 | 300, 0 | 300, 0 |
| SUB2 | 95, 1 | 300, 0 | 116, 1 | 300, 0 | 211, 1 |
| SUB3 | 300, 0 | 300, 0 | 85, 1 | 300, 0 | 295, 0 |
BROWSE - w/o TRAINING
| Q1 | Q2 | Q3 | Q4 | Q5 | |
| SUB1 | 300, 0 | 300, 0 | 300, 0 | 300, 0 | 300, 0 |
| SUB2 | 300, 0 | 80, 1 | 258, 0 | 63, 1 | 300, 0 |
| SUB3 | 221, 1 | 300, 0 | 300, 0 | 300, 0 | 118, 1 |
SEARCH - w/o TRAINING
| Q1 | Q2 | Q3 | Q4 | Q5 | |
| SUB1 | 300, 0 | 300, 0 | 240, 1 | 300, 0 | 300, 0 |
| SUB2 | 204, 1 | 284, 1 | 300, 0 | 300, 0 | 76, 1 |
| SUB3 | 300, 0 | 300, 0 | 292, 1 | 300, 0 | 129, 1 |
BROWSE OR SEARCH - w/ TRAINING
| Q1 | Q2 | Q3 | Q4 | Q5 | |
| SUB1 | 105, 1 | 300, 0 | 156, 1 | 212, 0 | 270, 1 |
| SUB2 | 300, 0 | 300, 0 | 280, 1 | 300, 0 | 240, 1 |
| SUB3 | 132, 1 | 300, 0 | 195, 1 | 300, 0 | 167, 1 |
BROWSE OR SEARCH - w/o TRAINING
| Q1 | Q2 | Q3 | Q4 | Q5 | |
| SUB1 | 205, 1 | 138, 0 | 105, 1 | 300, 0 | 300, 0 |
| SUB2 | 205, 1 | 300, 0 | 300, 0 | 157, 0 | 300, 0 |
| SUB3 | 117, 1 | 300, 0 | 135, 1 | 261, 1 | 228, 1 |
Back to the list of appendices
Appendix 6 - Browse with Training v/s Search with Training
Anova: Single Factor
SUMMARY
Groups
Count Sum
Average
Variance
b w/ tr 15
3016 201.0666667
9182.781
s w/ tr
15 3566
237.7333333
9113.638
ANOVA
Source of Variation SS
df
MS F
P-value
F crit
Between Groups 10083.33 1
10083.33333 1.102219 0.302757
4.195982
Within Groups 256149.9
28 9148.209524
Total 266233.2
29
t-Test: Paired Two Sample for Means
b w/
tr s
w/ tr
Mean 201.0667
237.7333
Variance 9182.781
9113.638
Observations 15
15
Pearson Correlation
-0.01016
Hypothesized Mean Difference 0
df
14
t Stat &a
mp;n
bsp; -1.04458
P(T<=t) one-tail 0.156961
t Critical one-tail 1.761309
P(T<=t) two-tail 0.313921
t Critical two-tail 2.144789
Back to the list of appendices
Appendix 7 - Browse without Training v/s Search without Training
Anova: Single Factor
SUMMARY
Groups
Count Sum
Average
Variance
b w/o tr 15
3740 249.33333333 &
;nbs
p; 7656.524
s w/o tr
15 3925 261.66666667 &a
mp;n
bsp; 5036.524
ANOVA
Source of Variation SS
df
MS F
P-value
F crit
Between Groups 1140.833 1
1140.833333 0.179757 0.674822
4.195982
Within Groups 177702.7
28 6346.52381
Total 178843.5
t-Test: Paired Two Sample for Means
b w/o
tr s
w/o tr
Mean 249.3333
261.6667
Variance 7656.524
5036.524
Observations 15
15
Pearson Correlation
0.063363
Hypothesized Mean Difference 0
df
14
t Stat &a
mp;n
bsp; -0.43777
P(T<=t) one-tail 0.334117
t Critical one-tail 1.761309
P(T<=t) two-tail 0.668235
t Critical two-tail 2.144789
Back to the list of appendices
Appendix 8 - Browse with Training v/s Browse without Training
Anova: Single Factor
SUMMARY
Groups
Count Sum
Average
Variance
b w/ tr 15
3016 201.06666667 &
;nbs
p; 9182.781
b w/o tr 15
3740 249.33333333
;
; 7656.524
ANOVA
Source of Variation SS
df
MS F
P-value
F crit
Between Groups 17472.53 1
17472.5333 2.075208 0.160799
4.195982
Within Groups 235750.3 28
8419.65238
Total 253222.8
t-Test: Paired Two Sample for Means
b w/
tr b
w/o tr
Mean
201.0667 249.3333
Variance
9182.781 7656.524
Observations 15
15
Pearson Correlation
0.039455
Hypothesized Mean Difference 0
df
14
t Stat &a
mp;n
bsp; -1.46972
P(T<=t) one-tail 0.081875
t Critical one-tail 1.761309
P(T<=t) two-tail 0.16375
t Critical two-tail 2.144789
Back to the list of appendices
Appendix 9 - Search with Training v/s Search without Training
Anova: Single Factor
SUMMARY
Groups
Count Sum
Average
Variance
s w/ tr 15
3566 237.73333333 &
;nbs
p; 9113.638
s w/o tr 15
3925 261.66666667
;
; 5036.524
ANOVA
Source of Variation SS
df
MS F
P-value
F crit
Between Groups 4296.033 1
4296.033333 0.607206 0.442378
4.195982
Within Groups 198102.3 28
7075.080952
Total 202398.3
t-Test: Paired Two Sample for Means
s w/
tr s
w/o tr
Mean
237.7333 261.6667
Variance
9113.638
5036.524
Observations 15
15
Pearson Correlation
0.216632
Hypothesized Mean Difference 0
df
14
t Stat &a
mp;n
bsp; -0.87529
P(T<=t) one-tail 0.198092
t Critical one-tail 1.761309
P(T<=t) two-tail 0.396183
t Critical two-tail 2.144789
Back to the list of appendices
Appendix 10 - Browse or Search with Training v/s Browse or Search without Training
Anova: Single Factor
SUMMARY
Groups
Count Sum
Average
Variance
sb w/ tr 15
3557 237.13333333 &
;nbs
p; 4932.838
sb w/o tr 15
3351 223.4
5869.543
ANOVA
Source of Variation SS
df
MS F
P-value
F crit
Between Groups 1414.533 1
1414.533333 0.261893 0.612835
4.195982
Within Groups 151233.3 28
5401.190476
Total 152647.9
t-Test: Paired Two Sample for Means
sb w/
tr sb
w/o tr
Mean
237.1333 223.4
Variance
4932.838
5869.543
Observations 15
15
Pearson Correlation
0.425002
Hypothesized Mean Difference 0
df
14
t Stat &a
mp;n
bsp; 0.673946
P(T<=t) one-tail 0.25566
t Critical one-tail 1.761309
P(T<=t) two-tail 0.51132
t Critical two-tail 2.144789