2011 Poster Sessions : Shepherding the Crowd: Managing and Providing Feedback to Crowd Workers

Student Name : Steven Dow
Advisor : Scott Klemmer
Research Areas: Graphics/HCI
Micro-task platforms provide a marketplace for hiring people to do short-term work for small payments. Requesters often struggle to obtain high-quality results, especially on content-creation tasks, because work cannot be easily verified and workers can move to other tasks without consequence. Such crowdsourcing platforms provide little opportunity for workers to reflect and improve their task performance. Timely and task-specific feedback can help crowd workers learn, persist, and produce better results. We analyze the design space for crowd feedback and introduce Shepherd, a prototype system for visualizing crowd work, providing feedback, and promoting workers into shepherding roles. We describe our current progress and our plans for system development and evaluation.

Steven Dow is a Postdoctoral Scholar in the HCI Group at Stanford University where he researches human-computer interaction, creative problem-solving, prototyping practices, and crowdsourcing methods. He is recipient of Stanford’s Postdoctoral Research Award and co-recipient of a Hasso Plattner Design Thinking Research Grant. He received an MS and PhD in Human-Centered Computing from the
Georgia Institute of Technology, and a BS in Industrial Engineering from University of Iowa. http://www.stanford.edu/~spdow/