$50 CrowdFlower Credit
Thanks to continuing sponsorship from CrowdFlower, we are once again able to offer free credits to anyone wanting to try crowdsourcing via their platform. Anyone who commits to submitting a workshop paper can request the free $50 credit (provided they did not already receive CrowdFlower credit from the CSE 2010 workshop at SIGIR). Just create a CrowdFlower account, then email joseph at crowdflower dot com and CC Matt Lease to request the credit per participation in the CSDM 2011 workshop.
We invite submissions of papers describing novel, unpublished research addressing one or more of the following areas:
- Theoretical, experimental, and/or methodological developments advancing state-of-the-art knowledge of crowdsourcing for search or data mining
- Applications of search or data mining related crowdsourcing.
- Tutorials on how different forms of crowdsourcing can be best suited to or best executed in evaluating different search or data mining tasks
- New software packages which simplify or otherwise improve general support for crowdsourcing, or particular support for related crowdsourced tasks (e.g. TurkIt, qmturk, Turk Surveyor, Get Another Label, etc.)
- Reflective or forward-looking vision on use of crowdsourcing in this area
Most Innovative Awards - Sponsored by Microsoft
Similar to the Crowdsourcing for Search Evaluation Workshop (CSE 2010) at SIGIR, the most novel and innovative papers will be recognized with "Most Innovative Awards" as judged by the workshop organizers. Selection will be based on the creativity, originality, and potential impact of the described proposal, and we expect the winners to describe risky, ground-breaking, and unexpected ideas. The provision of awards is thanks to generous support from Microsoft Bing, and the number and financial amount of the awards will depend on the quality of the submissions and overall funding. All valid submissions to the workshop will be considered for the awards.
While mature research is certainly welcome, we particularly invite submissions of new and innovative ideas that may only have preliminary evaluation. Similar to WSDM 2009’s Late Breaking-Results track, we especially welcome more risky and/or ground-breaking, innovative research ideas, methods, results, and position statements.
Submitted papers will be evaluated on the basis of novelty, technical depth, elegance, practical application, impact, and presentation. Particular emphasis will be placed on innovation, especially with respect to “Most Innovative Awards” (described below). Selection of these awards by the organizers will focus on the creativity, originality, and potential impact of the work with less emphasis on demonstrating a well-proven, empirically established technique. We encourage authors to submit risky, ground-breaking, and unexpected ideas.
Special issue of Information Retrieval journal on Crowdsourcing
Workshop organizers will edit a special issue of Information Retrieval, a Springer journal, on Crowdsourcing for Information Retrieval. See the call for papers. The timing of the special issue will allow workshop participants an opportunity to develop extended versions of their workshop papers for submission to the special issue (with separate refereeing from the workshop).
Workshop Submission Guidelines
Short papers should be no longer than 4 pages, including all references and figures. Posters should be no longer than 2 pages.
Papers must follow WSDM 2011 formatting guidelines and be submitted in either Adobe Portable Document Format (PDF) or Microsoft Word Format (doc). Please ensure that any special fonts used are included in the submitted documents.
Papers should be submitted via EasyChair. All papers must be original and must not have been published or under review elsewhere.
Important Dates
| Submissions due | Sunday, December 5, 2010 (extended) |
| Notification of acceptance | January 5, 2010 |
| Camera-ready version due | January 12, 2010 |
| Workshop | February 9, 2011 |