A new study looks at MTurk for biomedical research.
There were two interesting points. First, the study said that crowdsourcing shouldn’t be used to replace experts, but rather to extend and reinforce the ‘gold standard’. That is a bit different from other studies that show that Turkers do just as well as experts, but then this study is looking at biomedicine so that could explain that difference.
The other point is that there are institutional issues in that federal funding will not fund projects using MTurk since it is seen as a consumer survey and not a research tool. This is the first I’ve heard of that–have any of my readers heard of this?
Citation: Title: Crowdsourcing in biomedicine: challenges and opportunities
Author: Khare, Ritu