CloudResearch Blog

TurkPrime Blog

Are MTurk workers who they say they are?

Posted by Leib Litman on Dec 1, 2017 2:19:00 PM

The internet has the reputation of being a place where people can hide in anonymity, and present as being very different people than who they actually are. Is this a problem on Mechanical Turk? Is the self-reported information provided by Mechanical Turk workers reliable? These are important questions which have been addressed with several different methods. Researchers have examined a) consistency of responding to the same questions over time and across studies b) the validity of responses, or the degree to which the items capture responses that represent the truth from participants. It turns out that there are certain situations in which MTurk workers are likely to lie, but they are who they say they are in almost all cases.

Read More

Topics: amazon mechanical turk, anonymous, demographics, HIT, mturk, panels, qualification, turkprime panels, unique worker, worker groups, workers

Strengths and Limitations of Mechanical Turk

Posted by Leib Litman on Nov 20, 2017 11:12:00 PM

Hundreds of academic papers are published each year using data collected through Mechanical Turk. Researchers have gravitated to Mechanical Turk primarily because it provides high quality data quickly and affordably. However, Mechanical Turk has strengths and weaknesses as a platform for data collection. While Mechanical Turk has revolutionized data collection, it is by no means a perfect platform. Some of the major strengths and limitations of MTurk are summarized below.

Read More

Topics: amazon mechanical turk, demographics, exclude workers, google form mechanical turk, HIT, mechanical turk, mturk, mturk api, panels, qualification, study, turkprime panels, unique worker, worker groups, workers

Demographic Consistency Over Time on Mechanical Turk

Posted by TurkPrime on Apr 12, 2016 12:15:00 PM

Problem

Ever wonder if workers are being honest with you when they answer a survey? Or, if you specify that your study should be taken only by Women, whether some workers take the study even though they are not women?

Read More

Topics: amazon mechanical turk, demographics, gender gap, mechanical turk, mturk, panels

Creating Mechanical Turk Custom Panels with TurkPrime Worker Groups

Posted by Jonathan Robinson on Mar 23, 2015 1:29:00 PM

Problem:

Suppose you need to run a group of HITs open only to participants who are women under 50. You previously ran a HIT and know the Worker IDs that you want to reach, but have no way to email them and limit your survey to only them. How can you proceed?

Read More

Topics: amazon mechanical turk, mechanical turk, mturk api, panels, qualification, worker groups

Subscribe Here!

Recent Posts

Posts by Tag

See all