TurkPrime Blog

TurkPrime Blog

Are MTurk workers who they say they are?

Posted by Leib Litman on Dec 1, 2017 2:19:00 PM

The internet has the reputation of being a place where people can hide in anonymity, and present as being very different people than who they actually are. Is this a problem on Mechanical Turk? Is the self-reported information provided by Mechanical Turk workers reliable? These are important questions which have been addressed with several different methods. Researchers have examined a) consistency of responding to the same questions over time and across studies b) the validity of responses, or the degree to which the items capture responses that represent the truth from participants. It turns out that there are certain situations in which MTurk workers are likely to lie, but they are who they say they are in almost all cases.

Read More

Topics: amazon mechanical turk, anonymous, demographics, HIT, mturk, panels, qualification, turkprime panels, unique worker, worker groups, workers

Strengths and Limitations of Mechanical Turk

Posted by Leib Litman on Nov 20, 2017 11:12:00 PM

Hundreds of academic papers are published each year using data collected through Mechanical Turk. Researchers have gravitated to Mechanical Turk primarily because it provides high quality data quickly and affordably. However, Mechanical Turk has strengths and weaknesses as a platform for data collection. While Mechanical Turk has revolutionized data collection, it is by no means a perfect platform. Some of the major strengths and limitations of MTurk are summarized below.

Read More

Topics: amazon mechanical turk, demographics, exclude workers, google form mechanical turk, HIT, mechanical turk, mturk, mturk api, panels, qualification, study, turkprime panels, unique worker, worker groups, workers

MTurk Panels on Your Own Requester Account

Posted by Jonathan Robinson on Sep 8, 2016 6:44:00 PM

Studies with Panels  for just $0.15 - 0.75 / complete

Now you can run Mechanical Turk studies using your own Requester account and specify over two dozen demographic traits!. The traits include gender, ethnicity, age, marital status and sexual orientation. But it does not stop there! The available options also include occupation, medical and health history, cell phone use and much more.

Read More

Topics: amazon mechanical turk, demographics, mechanical turk, mturk, qualification, traits, turkprime, turkprime panels

Demographic Consistency Over Time on Mechanical Turk

Posted by Tzvi Abberbock on Apr 12, 2016 12:15:00 PM

Problem

Ever wonder if workers are being honest with you when they answer a survey? Or, if you specify that your study should be taken only by Women, whether some workers take the study even though they are not women?

Read More

Topics: amazon mechanical turk, demographics, gender gap, mechanical turk, mturk, panels

Maximizing HIT Participation

Posted by Jonathan Robinson on May 13, 2015 1:00:00 PM

Problem:

How can you increase Amazon Mechanical Turk HIT Worker participation rates and speed completion of a HIT? This is particularly an issue with HITs that have a large number of required participants or have Qualifications that limit the number of qualified Workers

Read More

Topics: amazon mechanical turk, completion rate, demographics, HIT, increase participation, qualification, speed, turkprime

The New New Demographics on Mechanical Turk: Is there Still a Gender Gap?

Posted by TurkPrime on Mar 12, 2015 4:56:00 AM

Overview

In this blog, we report on the demographics of Mechanical Turk workers by reviewing 75 studies conducted with US-based Workers in 2013 and 2014. From a total of 32,595 Workers, we found 15,324 were female (47%).

Background

It’s been a while since the last update on the demographics of Mechanical Turk Workers, so we thought it’s time for a new look. The current consensus seems to be that MTurk Workers are primarily female. For example, Panos Ipeirotis' blog reports that US-based Workers are 65% female. MTurk is always changing, though, so this report presents data from 75 studies conducted over the last two years.

Read More

Topics: amazon mechanical turk, demographics, gender gap, mechanical turk

Why use TurkPrime Panels?

Posted by Leib Litman on Feb 20, 2015 12:50:00 PM

MTurk Requesters are often interested in studying specific groups of people. For example, a researcher may be interested in men over 40, Republicans, people who are concerned about the cleanliness of sponges, or cancer survivors. TurkPrime Panels utilizes various techniques that make the process of acquiring specific MTurk samples faster and cheaper. We virtually guarantee to be able to get panels more economically than most Requesters are able to do on their own. Additionally, we can get the panels a lot faster, and eliminate the considerable amount of manual work that is required to obtain panels.

Read More

Topics: amazon mechanical turk, demographics, mechanical turk, requester, turkprime panels