Creating Compensation HITs for Mechanical Turk Workers

Posted by TurkPrime on Nov 15, 2018 10:00:00 AM
TurkPrime
   

At TurkPrime, we advocate for requesters to treat workers fairly when posting HITs on Amazon’s Mechanical Turk (MTurk). Workers are, after all, the people who make the research possible. Sometimes situations arise in which an MTurk worker is unable to receive payment, despite having completed a survey. Below are two common scenarios in which a worker may not be paid, despite completing a survey:

Problem

  1. Imagine a worker taking your survey on a poor internet connection. The worker submits their secret code at the end of the survey, but because of the poor connection or a disruption in service, the HIT registers on TurkPrime but not on MTurk. In this situation, you may see the HIT listed in your .csv file as “submitted to TurkPrime.” You may also notice that your HIT has completed, but the progress bar is one worker short of the requested total. For more on this, read "Why has my study been marked as “Complete” when it is short of the requested number of participants?" knowledge base article.

    In this situation, the worker may email you saying, “I took your survey, but I do not see it pending on my dashboard. Can you please compensate me for my time?” or “I submitted the HIT, but I’m not sure it went through. Can you confirm my payment?”

  2. Imagine a worker is taking your survey and they are concentrating diligently on it. The worker attempts to submit the HIT, but cannot because they have taken too much time and the HIT has expired. You then receive an email from the worker stating, “I took your entire survey, but, when I went to submit the HIT, it had already expired. Could you please compensate me?”

    Note: TurkPrime recommends setting the maximum time to complete a HIT to at least double the amount of time the survey is expected to take. Ideally, you should give workers three or four times as long as you expect the study to take because some people will be slower than others.

Solution

Compensation HIT Feature

In scenarios like the ones described above, you can use TurkPrime’s Compensation HIT feature to pay workers. Compensation HITs are regular MTurk HITs that only require the worker to accept and submit the HIT to receive payment. Once a worker submits your Compensation HIT, TurkPrime will automatically approve and pay the worker. You could manually create compensation HITs on your own, but our feature greatly simplifies and speeds up the process.

To create a Compensation HIT, go to the “Manage Workers” tab and select “Create Compensation HIT” from the drop-down menu.

Manage Workers option in TurkPrime interface

Create Compensation HIT option in TurkPrime interface

Once you choose to “Create a Compensation HIT,” you will be taken to the Create Compensation HIT page.
Create Compensation HIT page on TurkPrime

When compensating workers, please keep in mind that regular TurkPrime fees apply in addition to the 20% Amazon fee and the TurkPrime pro features fee. Visit the Pricing page for more details.
TurkPrime pricing message

In the large textbox, enter the Amazon Mechanical Turk IDs or TurkPrime IDs of the workers you would like to compensate. Enter each ID on a separate line.
Specify workers to compensate on TurkPrime

Next, enter the amount you would like to compensate the worker(s) and save the HIT.
Payment window

Save HIT for compensating workers on TurkPrime

After saving your HIT, you will be returned to the study dashboard where you will see your Compensation HIT on the top of your study list.
Study dashboard showing your Compensation HIT

After launching your study, we recommend emailing workers to notify them that you have created a compensation HIT for them. You must wait 6 minutes from the time the HIT is launched before emailing workers.
Dashboard showing elapsed time since compensation HIT created

The Email Included Workers button will light up orange when you can email the workers. Once you have emailed workers, it will keep track of how long it has been since your last mass email notification.
Email workers option in TurkPrime dashboard

Bonusing Workers

An alternative method of compensating workers is to issue them a bonus by clicking on the green “Grant Bonuses” button in your original HIT. You can issue a bonus to any study a worker has taken, even if it has already completed.

Please note: You can only grant a bonus to a worker who has completed at least one HIT for you previously. For workers who are taking one of your HITs for the first time, bonuses are not an option.
Grant Bonuses option in TurkPrime platform

You will be taken to the grant bonus page (see below).
Grant bonus to approved workers

For bonus HITs, only a 20% Amazon fee is applied.
Amazon fee for bonuses

Please note that worker bonuses are cumulative. If you have given a worker a bonus of $2 in the past and would like to grant them a $3 bonus now, you must enter $5 into the amount text box.
Giving a worker multiple bonuses on TurkPrime

You may check how much you have bonused a worker in the past by entering their Amazon ID into the Check Bonus textbox.
Option to check previous bonus for worker

To bonus a worker, enter the worker’s MTurk or TurkPrime ID into the “Worker IDs” textbox on separate lines. You may also include a message.
Bonus Workers Window

New Bonus Feature

Alternatively, you can also bonus workers using our new feature that allows you to send different bonus amounts to different workers all at once.
Bonus Multiple Workers

To use this feature you must input a .csv file that has the MTurk IDs in the first column and the payment amount in the second column. You can download a .csv file from your study dashboard that includes MTurk IDs, as well as other information on the study.
CSV file with worker IDs

CSV file with MTurk IDs in first column

Next, drag and drop the file you just created into the drag and drop field.
Drag and drop field

Success! You have just compensated the workers on your list!

While there are some scenarios that can engender a MTurk worker losing pay, TurkPrime offers several options for requesters to compensate workers. As always, we encourage requesters to be considerate of workers’ time and to compensate workers fairly when possible.

Topics: mechanical turk, amazon mechanical turk, compensating workers, how to compensate workers, how to compensate workers on TurkPrime

Subscribe Here!

Recent Posts