TurkPrime Blog

TurkPrime Blog

TurkPrime

TurkPrime
Find me on:

Recent Posts

Verified US Region Targeting

Posted by TurkPrime on Dec 2, 2016 1:22:00 PM

Problem

Many researchers wish to target participants from specific states or regions of the United States like the Northeast or the West. The problem they often encounter is that using MTurk's Geographic Qualification to specify a particular state is often not adequate to ensure participants actually reside in the specified state.

Read More

Topics: amazon mechanical turk, exclude workers, IP address, IP block, location, region, survey, turkprime

Dynamic Secret Completion Codes for SurveyMonkey

Posted by TurkPrime on Dec 2, 2016 1:04:00 PM

What is the completion rate and dropout rate?

Dropout rate is defined as the percentage of participants who start taking a study but do not complete it. Dropout rate is sometimes referred to as attrition rate, and is the opposite of completion rate (dropout rate = 100 – completion rate). On MTurk, completion rate is defined as the number of Workers who submit a HIT divided by the number of Workers who accept the HIT. Note that, for the definition of completion rate used here, Rejected Workers are counted as completes.

Read More

Topics: amazon mechanical turk, autoapproval, completion code, dynamic, mturk, secret code, surveymonkey, turkprime

Paying Workers Who Could Not Submit an Assignment

Posted by TurkPrime on May 11, 2016 2:22:00 PM

On occasion a worker may have completed a study but was unable to successfully submit the assignment  for a variety of reasons (timeout, system hiccup, computer shutdown). In such cases researchers are encouraged to follow up with the workers and open a special HIT specifically for them.

Read More

Topics: Uncategorized

Demographic Consistency Over Time on Mechanical Turk

Posted by TurkPrime on Apr 12, 2016 12:15:00 PM

Problem

Ever wonder if workers are being honest with you when they answer a survey? Or, if you specify that your study should be taken only by Women, whether some workers take the study even though they are not women?

Read More

Topics: amazon mechanical turk, demographics, gender gap, mechanical turk, mturk, panels

Our Micro-batching Feature will Improve the Quality of Your Data

Posted by TurkPrime on Jun 29, 2015 7:57:00 AM

MicroBatch

We have deployed a micro-batching feature which allows Requesters to break up their studies into smaller segments, and to include time intervals between the segments. We developed this feature to increase sample representation. This feature can also save 50% in MTurk fees.

Read More

Topics: amazon mechanical turk, mechanical turk, microbatch, mturk, mturkgate

TurkPrime Video Tutorials to Get You Started with Mechanical Turk

Posted by TurkPrime on Jun 26, 2015 2:34:00 PM

TurkPrime now has tutorials to get you started

If you're looking for a video tutorial that explains how to setup your account on TurkPrime, how to run a longitudinal study, or how to limit who takes your HIT on Mechanical Turk, these resources are for you.

Read More

Topics: amazon mechanical turk, exclude workers, HIT, include workers, mturk, turkprime

The New New Demographics on Mechanical Turk: Is there Still a Gender Gap?

Posted by TurkPrime on Mar 12, 2015 4:56:00 AM

Overview

In this blog, we report on the demographics of Mechanical Turk workers by reviewing 75 studies conducted with US-based Workers in 2013 and 2014. From a total of 32,595 Workers, we found 15,324 were female (47%).

Background

It’s been a while since the last update on the demographics of Mechanical Turk Workers, so we thought it’s time for a new look. The current consensus seems to be that MTurk Workers are primarily female. For example, Panos Ipeirotis' blog reports that US-based Workers are 65% female. MTurk is always changing, though, so this report presents data from 75 studies conducted over the last two years.

Read More

Topics: amazon mechanical turk, demographics, gender gap, mechanical turk