How can a scalable and efficient quality management mechanism for cloud labor services be designed in a way that it delivers results with a well-defined level of quality to the requester?

Cloud labor services are a specific form of crowdsourcing: A coordination platform serves as an interface between requesters who need to get work done and a large crowd of workers who want to perform work. An early example of such a platform is Amazon’s Web marketplace Mturk, on which service requesters can publish open calls for so-called human intelligence tasks (HITs).