Instructions

PRACTICING

First, in the browser on your computer, make sure you're at the 'Welcome Page'. It's at
http://nlp.umiacs.umd.edu:8080/CPD_demo/838s/Welcome.html

There are practice queries that you can use to get familiar with how the system works:

1. On the welcome screen, click 'PRACTICE QUERY.'

2. You might need to give the following as your username and password:

USERNAME: _________________ PASSWORD: _________________

3.a. WAIT until the experimenter says to continue, so everyone clicks "Search" at the same time.
b. When the experimenter says "Search", click the "Search" button.

4. Read "Your Query" for a description of what you're looking for.

5. Click "View documents retrieved" to get the list of articles that are considered possibly relevant by the system. This will come up automatically in a new browser window.

6. At the top of the resulting page is a repetition of the query, to remind you what articles are relevant. Below that is a list of 50 articles: what you're seeing is the headline of each article, with each Chinese word translated as we have already described.

Your job is to find as many relevant documents as possible.

If you can tell an article is relevant or not relevant just from its title, you can choose "Rel" or "Not Rel" right away by selecting the button to the right of the headline. If you want to look at the whole article (translated), you can click on the headline to go there, and then click the "back" button of your browser to get back to the list.

Right now, just for practice, pick an article to look at. Click on the headline to go to the full article, and take a look at it. Then use the "Back" button on your browser to go back to the list, and click either "Rel" or "Not rel", or just leave "No response" if you prefer.

7. Go ahead and take a look at another article, and then use the "Back" button to go back to the list again.

8. When you're done with a search, scroll to the bottom and click the "Submit" button. Go ahead and do this right now.

9. As it says, please go back to your other browser window (the one where you chose Q1) and wait until you're instructed to continue.

THIS IS WHERE YOU WAIT. PLEASE DON'T CONTINUE UNTIL INSTRUCTED!

EXPERIMENT

We're going to do the same process over again, but this time we're going to do it for real.

1. Go back to

http://nlp.umiacs.umd.edu:8080/CPD_demo/838s/Welcome.html

2. This time, click on 'Enter'.

3. Type in the ID that's at the very top of these instructions.

4. Select the number of translations per word (2, 3 or 4)and click "Submit".

5. You'll have five (5) minutes for each search, and it's important that we all start at the same time. Please, start only when we give you the signal. If you finish a query early, please wait until
the time is up so that everybody can start the next one at the same time.

Here we go:

1. Select the query number Q1, and when the experimenter says "Search" (but not before!), click on 'Search'.

2. Now go ahead the same as when you practiced. When you hear the experimenter say "Please stop", please *immediately* stop working and listen for instructions. (If you finish early, go ahead and scroll down and click "Submit" and then wait for instructions.)

WAIT HERE FOR THE REST OF THE INSTRUCTIONS.

Thanks for your collaboration!