TurkPrime Blog

TurkPrime Blog

Tips for Navigating the TurkPrime Dashboard

Posted by TurkPrime on Jan 31, 2019 3:15:00 PM

In this blog, we highlight some subtle and not so subtle aspects of the TurkPrime Dashboard you can use to make navigation and completing study-related tasks easier. 

Read More

Topics: turkprime, TurkPrime Features, mturk toolkit, academic research, market research

Revisiting TurkPrime’s Survey Group Feature

Posted by TurkPrime on Jan 17, 2019 10:00:17 AM

What is a Survey Group?

Survey Groups are one of the most powerful and dynamic tools on TurkPrime for controlling which workers are eligible and ineligible for your study. A Survey Group is exactly what it sounds like: a collection of surveys or studies you have grouped together. Survey Groups are useful when you want to ensure your studies have unique workers. This may be a set of studies investigating the same topic or multiple studies being run in your lab at the same time for which you want no overlap in participants.

Read More

Topics: turkprime, mturk toolkit, TurkPrime Features

Announcing the TurkPrime Suggestion Box

Posted by TurkPrime on Jan 10, 2019 9:45:00 AM

A new year represents the opportunity to consider priorities, set goals, chart new courses of action, and decide how to move forward in the coming months. At TurkPrime, we’re moving into 2019 looking for ways to expand the tools and services we offer to researchers. In addition to several initiatives we’re already working on, we want to hear from you about the tools and features that can make your research easier. To this end, we’re announcing the launch of an online Suggestion Box.

Read More

Topics: turkprime, mturk toolkit, new features

After the Bot Scare: Understanding What’s Been Happening with Data Collection on MTurk and How to Stop it

Posted by TurkPrime on Sep 18, 2018 2:07:52 PM

Highlights

  • Since early August, researchers have worried that “bots” are contaminating data collected on MTurk.
  • We found workers who submit HITs from suspicious geolocations are using server farms to hide their true location.
  • When using TurkPrime tools to block workers from server farms, we collected high quality data from MTurk workers.
  • We also collected data from workers who use server farms to learn more about them.
  • Our evidence suggests recent data quality problems are tied to foreign workers, not bots.

In this blog, we review recent data quality issues on Mechanical Turk and report the results of a study we conducted to investigate the problem.

Read More

Topics: turkprime, bots, server farms, data quality, high quality data

Concerns about Bots on Mechanical Turk: Problems and Solutions

Posted by Leib Litman on Aug 10, 2018 6:46:00 PM

Data quality on online platforms

When researchers collect data online, it’s natural to be concerned about data quality. Participants aren’t in the lab, so researchers can’t see who is taking their survey, what those participants are doing while answering questions, or whether participants are who they say they are. Not knowing is unsettling.

Read More

Topics: bots, mechanical turk, mturk, quality, turkprime, workers

New Feature: Exclude Highly Active Workers

Posted by Leib Litman on Dec 15, 2017 12:30:00 PM

Some workers on MTurk are extremely active, and take the majority of posted HITs. This can lead to many issues, some of which are outlined in our previous post. Although MTurk has over 100,000 workers who take surveys each year, and around 25,000 who take surveys each month, you are much more likely to recruit highly active workers who take a majority of HITs. About 1,000 workers (1% of workers) take 21% of the HITs. About 10,000 workers (10% of workers) take 74% of all HITs.

Read More

Topics: active, active workers, amazon mechanical turk, exclude, exclude workers, HIT, mechanical turk, mturk, online research, turkprime, workers

Upcoming New Content on the Blog

Posted by TurkPrime on Nov 17, 2017 11:43:00 AM

Greetings Reader,

Read More

Topics: amazon mechanical turk, online research, primepanels, turkprime

New Feature: Select MTurk Workers by Big Five Personality Types

Posted by Jonathan Robinson on Oct 31, 2017 11:33:00 AM

Run Studies Targeting Specific Big Five Personality Types

TurkPrime introduces a new Big Five personality types qualification: Now social science researchers can run studies targeted to the Big Five:

Read More

Topics: turkprime panels, primepanels, turkprime

Verified US Region Targeting

Posted by TurkPrime on Dec 2, 2016 1:22:00 PM

Problem

Many researchers wish to target participants from specific states or regions of the United States like the Northeast or the West. The problem they often encounter is that using MTurk's Geographic Qualification to specify a particular state is often not adequate to ensure participants actually reside in the specified state.

Read More

Topics: amazon mechanical turk, exclude workers, IP address, IP block, location, region, survey, turkprime

Dynamic Secret Completion Codes for SurveyMonkey and SurveyGizmo

Posted by TurkPrime on Dec 2, 2016 1:04:00 PM

What is the completion rate and dropout rate?

Dropout rate is defined as the percentage of participants who start taking a study but do not complete it. Dropout rate is sometimes referred to as attrition rate, and is the opposite of completion rate (dropout rate = 100 – completion rate). On MTurk, completion rate is defined as the number of Workers who submit a HIT divided by the number of Workers who accept the HIT. Note that, for the definition of completion rate used here, Rejected Workers are counted as completes.

Read More

Topics: amazon mechanical turk, autoapproval, completion code, dynamic, mturk, secret code, surveymonkey, turkprime

Subscribe Here!

Recent Posts

Posts by Tag

See all