Making Turk better for Workers

Here is the full text of a new publication about designing HITs that workers will be more likely to accept as these design elements address some key Worker concerns, particularly the concern of unfair rejections (as perceived by workers).  These rejections come from poorly designed surveys, unclear criteria for rejection, inexperienced requesters, and more. The authors recommend several important fixes such as:

  • a straightforward appeal process for rejected work
  • automated feedback in task design
  • a design collective of workers and requesters

It is an interesting article with interesting ideas, but the question remains: will Amazon ever care enough to get Workers and Requesters to address these important issues?

Citation: McInnis, B., Cosley, D., Nam, C., & Leshed, G. (2016, May). Taking a HIT: Designing around Rejection, Mistrust, Risk, and Workers’ Experiences in Amazon Mechanical Turk. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 2271-2282). ACM.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s