Another study indicates MTurk workers are as ‘good’ as experts.

A new study by Aghdasi and colleagues found that crowdsourced workers were just as able to ‘grade’ a surgical procedure as expert surgeons could. I have to read this study because there was some degree of training involved that isn’t very clear in the abstract what exactly the training was. But the conclusion is interesting:

Conclusion: We found crowd sourcing was an efficient, accurate, and inexpensive method for skills assessment with good level of agreement to experts’ grading.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s