It is important to consider how many highly experienced workers there are on Mechanical Turk. As discussed in previous posts, there is a population pool of active workers in the thousands, but this is far from exhaustible. A small group of workers take a very large number of HITs posted to MTurk, and these workers are very experienced and have seen measures commonly used in the social and behavioral sciences. Research has shown that when participants are repeatedly exposed to the same measures, this can have negative effects on data collection, changing the way workers perform, creating treatment effects, giving participants insight into the purpose of some studies, and in some cases impact effect sizes of experimental manipulations. This issue is referred to as non-naivete (Chandler, 2014; Chandler, 2016).
Best recruitment practices: working with issues of non-naivete on MTurk
Topics: amazon mechanical turk, approval rating, experience, exposure, HIT, mechanical turk, mturk, naivete, non-naive, primepanels, qualification, recruitment, requester, workers
Greetings Reader,
Topics: amazon mechanical turk, online research, primepanels, turkprime
New Feature: Select MTurk Workers by Big Five Personality Types
Run Studies Targeting Specific Big Five Personality Types
TurkPrime introduces a new Big Five personality types qualification: Now social science researchers can run studies targeted to the Big Five:
Topics: primepanels, turkprime, turkprime panels