CloudResearch Blog

TurkPrime Blog

MTurk Worker Dynamics: How Many New Workers Join Each Month?

Posted by TurkPrime on Jul 30, 2019 8:15:00 AM

In a recent research article (https://psyarxiv.com/jq589/), we reported on the size of the MTurk worker pool. Using observed participation rates from the TurkPrime database, we found that over each of the last three years there have been approximately eighty to eighty-five thousand US workers active on MTurk each year (Figure 1). What these numbers do not illustrate is how often new workers join the platform—a number that is important for researchers who want to sample naive participants.

Read More

Topics: mturk, turkprime, mturk workers, turkprime research, participant pool

How to Award a Bonus to MTurk Workers Using TurkPrime

Posted by TurkPrime on Apr 10, 2019 10:00:00 AM
One feature of Mechanical Turk is the ability of researchers to give workers bonus payments. Bonuses may be issued for various reasons such as exemplary performance on a task, answering extra questions in a study, or as a reward for completing all the waves in a longitudinal study. In this blog, we describe the various ways you can use TurkPrime to grant MTurk workers a bonus.
Read More

Topics: amazon mechanical turk, turkprime, TurkPrime Features, mturk workers, worker bonus

Understanding Turkers: How Do Gig Economy Workers Use Amazon’s Mechanical Turk?

Posted by TurkPrime on Mar 15, 2019 2:36:02 PM

By now, most people have heard of the gig economy and have some idea of how it works. In the gig economy, people perform short-term jobs or tasks to earn money. Gig economy jobs are considered independent or contract work, meaning people who work in the gig economy often trade the benefits and stability of traditional employment for the freedom and flexibility to decide when and how much they work. Some of the most easily identifiable gig economy platforms are Uber, Lyft, AirBnB, and the slightly less mentioned Mechanical Turk or MTurk.

Read More

Topics: amazon mechanical turk, turkprime, market research, MTurk insights, mturk workers

How do most MTurk Workers work?

Posted by TurkPrime on Mar 1, 2019 10:22:47 AM

A persistent cause of concern for researchers who conduct studies online is understanding what participants might be doing while completing their study. When participants are outside the lab, they cannot be observed and distracting aspects of the environment cannot be controlled by the research team. As a result, researchers are left to wonder: how much attention are participants giving my survey?

In this blog, we report on one small aspect of this issue by describing the work style adopted by workers on Amazon’s Mechanical Turk.

Read More

Topics: amazon mechanical turk, turkprime, mturk toolkit, market research, MTurk insights

How to Easily Run a Pilot Study on TurkPrime

Posted by TurkPrime on Feb 21, 2019 10:00:00 AM

Last month, we published a blog titled, “Five Things you Should Not be Doing in Online Data Collection.” Among the things we identified that you should not be doing was launching your study without piloting it first. As a way to reiterate how important we think this issue is, we describe in this blog how to easily conduct a pilot study using TurkPrime.

Read More

Topics: turkprime, mturk toolkit, TurkPrime Features, research best practices, market research, research solutions

Tips for Navigating the TurkPrime Dashboard

Posted by TurkPrime on Jan 31, 2019 3:15:00 PM

In this blog, we highlight some subtle and not so subtle aspects of the TurkPrime Dashboard you can use to make navigation and completing study-related tasks easier. 

Read More

Topics: turkprime, mturk toolkit, TurkPrime Features, academic research, market research

Revisiting TurkPrime’s Survey Group Feature

Posted by TurkPrime on Jan 17, 2019 10:00:17 AM

What is a Survey Group?

Survey Groups are one of the most powerful and dynamic tools on TurkPrime for controlling which workers are eligible and ineligible for your study. A Survey Group is exactly what it sounds like: a collection of surveys or studies you have grouped together. Survey Groups are useful when you want to ensure your studies have unique workers. This may be a set of studies investigating the same topic or multiple studies being run in your lab at the same time for which you want no overlap in participants.

Read More

Topics: turkprime, mturk toolkit, TurkPrime Features

Announcing the TurkPrime Suggestion Box

Posted by TurkPrime on Jan 10, 2019 9:45:00 AM

A new year represents the opportunity to consider priorities, set goals, chart new courses of action, and decide how to move forward in the coming months. At TurkPrime, we’re moving into 2019 looking for ways to expand the tools and services we offer to researchers. In addition to several initiatives we’re already working on, we want to hear from you about the tools and features that can make your research easier. To this end, we’re announcing the launch of an online Suggestion Box.

Read More

Topics: turkprime, mturk toolkit, new features

After the Bot Scare: Understanding What’s Been Happening with Data Collection on MTurk and How to Stop it

Posted by TurkPrime on Sep 18, 2018 2:07:52 PM

Highlights

  • Since early August, researchers have worried that “bots” are contaminating data collected on MTurk.
  • We found workers who submit HITs from suspicious geolocations are using server farms to hide their true location.
  • When using TurkPrime tools to block workers from server farms, we collected high quality data from MTurk workers.
  • We also collected data from workers who use server farms to learn more about them.
  • Our evidence suggests recent data quality problems are tied to foreign workers, not bots.

In this blog, we review recent data quality issues on Mechanical Turk and report the results of a study we conducted to investigate the problem.

Read More

Topics: bots, turkprime, server farms, high quality data, data quality

Concerns about Bots on Mechanical Turk: Problems and Solutions

Posted by Leib Litman on Aug 10, 2018 6:46:00 PM

Data quality on online platforms

When researchers collect data online, it’s natural to be concerned about data quality. Participants aren’t in the lab, so researchers can’t see who is taking their survey, what those participants are doing while answering questions, or whether participants are who they say they are. Not knowing is unsettling.

Read More

Topics: bots, mechanical turk, mturk, quality, turkprime, workers

Subscribe Here!

Recent Posts

Posts by Tag

See all