Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
KissKissBan: a competitive human computation game for image annotation
Ho C., Chang T., Lee J., Hsu J., Chen K. ACM SIGKDD Explorations Newsletter12 (1):21-24,2010.Type:Article
Date Reviewed: Mar 16 2011

A game with a purpose (GWAP) provides a way to label images to support the work of search engines. For example, Google Image Labeler is a game where paired users win points by guessing the same label for an image. Would Google, however, be better off by deploying KissKissBan (KKB)? KKB involves a third player, the blocker, who competes against the collaborating pair. At each game turn, the blocker has time to type in blocking words. The collaborating pair suffers time penalties if it should guess a blocking word. The authors claim that KKB is fun to play and an efficient way to gather labels, and also that the labels gathered are more diverse.

A small questionnaire survey with 17 players supports the claim that KKB is indeed fun to play. In a gameplay comparison with a reimplementation of the ESP game (on which Google Image Labeler is based), KKB yielded 11.54 distinct labels per image versus 6.56 distinct labels for the usual two-player game, supporting the claim that the labels gathered are more diverse. There is, however, no evaluation of the quality of the labels. Regarding efficiency, the evaluation is again lacking, and there is no comparison of the actual time spent playing the games. A demanding reader would like to know if it is better to have two three-player games or three two-player games.

Despite these shortcomings, this paper is strongly recommended to those tackling the image-labeling problem. Competitive KKB might just be a very efficient and effective GWAP.

Reviewer:  Andy Brooks Review #: CR138904 (1109-0970)
Bookmark and Share
  Featured Reviewer  
 
Group And Organization Interfaces (H.5.3 )
 
 
Games (I.2.1 ... )
 
 
Knowledge Acquisition (I.2.6 ... )
 
 
Miscellaneous (H.5.m )
 
Would you recommend this review?
yes
no
Other reviews under "Group And Organization Interfaces": Date
The design of a system for distributing shared objects
Dollimore J., Miranda E., Xu W. The Computer Journal 34(6): 514-521, 1991. Type: Article
Jan 1 1993
Designing for demanding users
Sellers M. interactions 1(3): 54-64, 1994. Type: Article
Jun 1 1996
Collective intelligence in computer-based collaboration
Smith J., Lawrence Erlbaum Associates, Inc., Hillsdale, NJ, 1994. Type: Book (9780805813203)
May 1 1996
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy