TurkPrime Blog

TurkPrime Blog

Jonathan Robinson

Jonathan Robinson

Recent Posts

TurkPrime Tools to Help Combat Responses from Suspicious Geolocations

Posted by Jonathan Robinson on Aug 15, 2018 2:51:00 PM

Last week, the research community was struck with concern that “bots” were contaminating data collection on Amazon’s Mechanical Turk (MTurk). We wrote about the issue and conducted our own preliminary investigation into the problem using the TurkPrime database. In this blog, we introduce two new tools TurkPrime is launching to help researchers combat suspicious activity on MTurk and reiterate some of the important takeaways from this conversation so far.

Read More

Topics: amazon mechanical turk, bots, mechanical turk, mturk, workers

New Feature: Select MTurk Workers by Big Five Personality Types

Posted by Jonathan Robinson on Oct 31, 2017 11:33:00 AM

Run Studies Targeting Specific Big Five Personality Types

TurkPrime introduces a new Big Five personality types qualification: Now social science researchers can run studies targeted to the Big Five:

Read More

Topics: turkprime panels, primepanels, turkprime

How to Create a Universal Exclude Worker List

Posted by Jonathan Robinson on Sep 9, 2016 10:41:00 AM

Problem: 

Requesters may observe that some workers, even those with high Approval ratings, may not perform to their expectations on a study. Sometimes this may result in rejecting their work which affects the Worker approval rating. But, often the work is not acceptable for research but is not worthy of rejection, or, it may simply be the policy of the research lab to approve all assignments for IRB or some ethical standard they may follow.

Read More

Topics: amazon mechanical turk, block worker, exclude, exclude workers, mturk, mturk api, qualification, turkprime

Reusable Include and Exclude Groups

Posted by Jonathan Robinson on Sep 9, 2016 10:36:00 AM

Problem:

You are running a longitudinal study and have identified 1000 workers who you want to allow to take your second phase studies. How do you easily group those workers for easy access.

Or you want to exclude certain workers from taking a number of your studies and wish to group them for easy exclusion in future studies. How can you do that?

Read More

Topics: amazon mechanical turk, exclude, exclude workers, include workers, Longitudinal, qualification, turkprime, worker groups

MTurk Panels on Your Own Requester Account

Posted by Jonathan Robinson on Sep 8, 2016 6:44:00 PM

Studies with Panels  for just $0.15 - 0.75 / complete

Now you can run Mechanical Turk studies using your own Requester account and specify over two dozen demographic traits!. The traits include gender, ethnicity, age, marital status and sexual orientation. But it does not stop there! The available options also include occupation, medical and health history, cell phone use and much more.

Read More

Topics: amazon mechanical turk, demographics, mechanical turk, mturk, qualification, traits, turkprime, turkprime panels

Survey Groups Ensure Unique Workers Across Multiple Concurrent Studies

Posted by Jonathan Robinson on Aug 23, 2016 2:41:00 PM

Problem

Have you ever wanted to run multiple studies simultaneously  and make sure that each worker only takes a single study? On MTurk, there is no simple way to block workers who completed one study from accepting and completing another study being run at the same time....until now.

(Note: TurkPrime's exclude feature excludes workers who have completed one study from taking another subsequent study, but not if both studies are being run at the same time.)

Read More

Topics: amazon mechanical turk, exclude, exclude workers, follow up, qualification

Google Forms Integration with TurkPrime

Posted by Jonathan Robinson on Jul 26, 2016 3:02:00 PM

Google Forms can be used to deliver a study with TurkPrime in a similar manner to other survey platforms (like Qualtrics and SurveyMonkey).

Read More

Topics: google form mechanical turk, google forms, mechanical turk, mturk, secret code, secret key, survey, turkprime

New Safety Feature: Assignment Rejections are not Automated and Require Manual User Action

Posted by Jonathan Robinson on Feb 19, 2016 10:39:00 AM

Many researchers set up their studies to use the TurkPrime AutoApprove feature so that they do not need to manually approve worker assignments based on the secret code that workers enter. On occasion, a researcher may set up his study incorrectly which results in many worker assignments getting automatically rejected. This was a significant cause for distress among the Mechanical Turk workers who received rejections for their work which then went unpaid and also lowered their MTurk approval rating. This was also a sore point for TurkPrimeresearcherswho had to deal with upset workers and correspond with them, and often reverse their rejections.

Read More

Topics: amazon mechanical turk, autoapproval, reverse rejection, study, survey, turkprime

Anonymize Mechanical Turk Worker IDs

Posted by Jonathan Robinson on Jan 18, 2016 6:32:00 PM

We recently launched a ground-breaking feature that helps protect Mechanical Turk worker identities. It has been reported in the literature that Mechanical Turk Worker IDs can be used to identify the worker. This is because Amazon uses the same value for both the Worker ID on Mechanical Turk and elsewhere on Amazon properties like Amazon.com product reviews.

Read More

Topics: amazon mechanical turk, anonymize, anonymous, exclude workers, HIT, include workers, mechanical turk, mturk, turkprime

Block Multiple Responses from the Same IP Address

Posted by Jonathan Robinson on Jan 7, 2016 10:36:00 AM

Block Duplicate IP Addresses

Our most popular feature request has been to allow the blocking of multiple workers from the same IP address.

Read More

Topics: amazon mechanical turk, IP address, IP block, mechanical turk, unique worker, workerid