About Amazon Mechanical Turk 1/5

About Amazon Mechanical Turk 1/5


What is Amazon Mechanical Turk?

In 1769, Hungarian nobleman Wolfgang von Kempelen astonished Europe by building a mechanical chess-playing automaton that defeated nearly every opponent it faced. A life-sized wooden mannequin, adorned with a fur-trimmed robe and a turban, Kempelen’s “Turk” was seated behind a cabinet and toured Europe confounding such brilliant challengers as Benjamin Franklin and Napoleon Bonaparte. To persuade skeptical audiences, Kempelen would slide open the cabinet’s doors to reveal the intricate set of gears, cogs and springs that powered his invention. He convinced them that he had built a machine that made decisions using artificial intelligence. What they did not know was the secret behind the Mechanical Turk: a chess master cleverly concealed inside.

Today, we build complex software applications based on the things computers do well, such as storing and retrieving large amounts of information or rapidly performing calculations. However, humans still significantly outperform the most powerful computers at completing such simple tasks as identifying objects in photographs – something children can do even before they learn to speak.

When we think of interfaces between human beings and computers, we usually assume that the human being is the one requesting that a task be completed, and the computer is completing the task and providing the results. What if this process was reversed and a computer program could ask a human being to perform a task and return the results? What if it could coordinate many human beings to perform a task?

Amazon Mechanical Turk (MTurk) provides a service for service requesters (hereafter “Requesters”) to integrate Artificial Artificial Intelligence directly into their applications by making requests of humans. Requesters can use the MTurk web user interface or web services API to submit tasks to the MTurk web site, approve completed tasks, and incorporate the answers into their applications. When using the web services API, the transaction looks very much like any remote procedure call – the application sends the request, and the service returns the results. In reality, a network of human Workers (hereafter “Workers”) fuels this Artificial Artificial Intelligence by coming to the web site, searching for and completing tasks, and receiving reward for their work.

What problem does Amazon Mechanical Turk solve?

  • For software developers, the Amazon Mechanical Turk (MTurk) web service solves the problem of building applications that until now have not worked well without human intelligence. Humans are much more effective at solving some types of problems, like finding specific objects in pictures, e v a luating beauty, or translating text. The idea of the MTurk web service is to give developers a programmable interface to a network of humans to solve these kinds of problems and incorporate this human intelligence into their applications.
  • For businesses and entrepreneurs who want tasks completed, the MTurk service solves the problem of accessing a vast network of human intelligence with the efficiencies and cost-effectiveness of computers. Oftentimes people do not move forward with certain projects because the cost to establish a network of skilled Workers to do the work outweighs the value of completing it. By turning the fixed costs into variable costs that scale with their needs, the MTurk web service eliminates this barrier and allows projects to be completed that before were not economical.
  • For people who want to earn money in their spare time, the MTurk web site solves the problem of finding work you can do wherever and whenever you want using the skills you already possess.

How do Requesters ensure their tasks are completed in a high-quality manner?

Requesters have several options for ensuring their HITs (Human Intelligence Tasks) are completed in a high-quality manner.

  • Requesters have the opportunity to approve completed HITs before having to pay for them. There are many ways Requesters can approve HITs, ranging from auto-approving them sight unseen, to auto-approving them when they receive two answers to the same HIT that match, to manually approving some or all completed HITs.
  • Requesters can specify that people who work on their tasks must first complete a qualification test, thus giving Requesters the opportunity to vet the skill level of the people working on their HITs beforehand. Over time people who do work on the Amazon Mechanical Turk web site will have statistics associated with them based on how accurately they have completed other HITs. These statistics, such as the percentage of HITs they’ve submitted that have been approved, allow Requesters to specify further that only Workers with certain qualifications can work on their HITs.

Who completes the tasks on Amazon Mechanical Turk and how do they complete them?

  • Virtually anyone can complete tasks on the Amazon Mechanical Turk (MTurk) web site using the skills they already have and according to their own schedule. The only requirement to complete tasks and collect payment from Requesters is a computing device connected to the Internet and to be at least 18-years-old.
  • Earning money through the MTurk web site is as easy as searching for HITs on the site, accepting those HITs, completing them, and collecting the reward once the HIT is approved by the Requester.

What kind of work can be done using Amazon Mechanical Turk?

  • Anyone can submit virtually any task that can be completed using a computing device connected to the Internet.
  • Amazon came up with the idea for Amazon Mechanical Turk to help solve specific internal data processing problems that required human judgment and intelligence. We quickly realized that we had invented something unique and incredibly useful, and decided to expose it as an external web service so that Requesters can create their own innovative applications that use human intelligence as a core component.

How do Workers collect money for the tasks they complete?

When a Requester approves a task, Amazon Mechanical Turk (MTurk) transfers Requester funds to the MTurk account of the Worker who completed the task. Workers in the United States can transfer earnings to their Amazon Payments account or to their Amazon.com gift card balance. Workers outside of the United States can transfer earnings to their Amazon.com gift card balance, and some Workers may be eligible to transfer earnings to their bank accounts.