I wonder if this sort of work could be done using Amazon.com's Mechanical Turk (http://www.mturk.com/), or something like it -- a giant web app that interfaces between people and programs and has group proofing built in.