• Skip to main content
  • Skip to primary sidebar
  • Skip to footer

eagereyes

Visualization and Visual Communication

  • Explore
    • Starter Pack
    • Blog Calendar
    • Blogroll
    • eagereyesTV YouTube Videos
  • Practical
    • Basics
    • Pie Charts
    • Techniques
    • Book Reviews
    • Journalism
  • Academic
    • Speaking Mistakes
    • Acceptance Rates
    • Papers
    • Conference Reports
    • Lists of Influences
    • Criticism
    • Peer Review
  • Admin
    • About
    • Contact
    • License
Prolific, the (Much Better) Mechnical Turk Alternative

Robert Kosara / November 4, 2019

Prolific, the (Much Better) Mechnical Turk Alternative

Prolific is a crowd-sourcing platform for running studies. In contrast to the widely-used Mechanical Turk, it’s specific to studies, has a much better interface, pricing that’s fair to participants, and useful filters to find the right people for your study.

Amazon’s Mechanical Turk is used for many empirical studies published in the visualization literature, but every time I’ve used it I’ve been just amazed at how ugly and poorly designed it is. It’s also annoying to have to split up your study into nine-participant chunks to avoid the 20% “tax” you pay from the tenth participant in the same HIT.

The Prolific study interface is way cleaner and more useful than MTurk. This is showing the 3D pie charts study I just got published at VIS.

Prolific is much simpler and cleaner. The service is specific to running studies, which means you get more motivated participants. They can also expect to be paid more fairly, since Prolific’s pricing is based on a reasonable minimum wage, which again helps motivation and data quality. This can make studies there look more expensive, but it includes their fees and a fair wage.

It’s really easiest if you just sign up and check it out yourself. If you’re not convinced, see some of the responses to my tweet about Prolific during VIS, including from people who participate in studies.

Mechanical Turk may be a good general platform for crowdsourcing, but for running studies, Prolific is far superior.

Filed Under: Blog 2019

Robert Kosara is Data Visualization Developer at Observable. Before that, he was Research Scientist at Tableau Software (2012–2022) and Associate Professor of Computer Science (2005–2012). His research focus is the communication of data using visualization. In addition to blogging, Robert also runs and tweets. Read More…

Reader Interactions

Leave a Reply Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

More Blog 2019 Articles

  • Review: Alberto Cairo, How Charts Lie
  • eagereyesTV: What is Data? Part 1, File Formats and Intent
  • eagereyesTV Episode 3: 3D Pie Charts For Science!
  • Paper: Evidence for Area as the Primary Visual Cue in Pie Charts
  • eagereyesTV Episode 2: Unit Charts, Dot Plots, ISOTYPE, and What Makes Them Special

Recently Popular

  • The US ZIPScribble Map
  • New, Improved Traveling Presidential Candidate Map
  • Chart Junk Considered Useful After All
  • Data: Continuous vs. Categorical
  • The Travelling Presidential Candidate Map
  • New video: Gauges for Data Visualization, The NY Times Election Needle, and Circular Bar Charts
  • The Simple Way to Scrape an HTML Table: Google Docs
  • Facebook
  • GitHub
  • LinkedIn
  • RSS
  • Twitter
  • YouTube

Subscribe via Email

Footer

  • About
  • Contact
  • License

Copyright © 2006–2022 Robert Kosara · All original materials are available under CC-BY-SA

 

Loading Comments...