Bonus Program

We have recently introduced a program that awards bonuses to workers on some of our jobs. Three interconnected pieces help you improve your transcription skill and earn larger bonuses: the Bonus Program, the Ratings System, and the Displayed Corrections.

About the Bonus Program

• We now award a numeric rating to each job you do.
• After each job is reviewed, we will send you your rating.
• Each job with a rating above 90 will receive a bonus.
• The maximum bonus will be 50% of the job's reward.
• The higher your score, the higher your bonus.

How the Ratings are calculated

• The rating for a job is based on how many errors you made.
• If your transcription had no errors, your rating would be 100.
• If your transcription was completely wrong your rating would be 0.
• Your overall rating, as displayed in MTurk, is currently based on the average of earlier ratings.
• Our client has very high accuracy expectations, so your ratings may be lower than you expect
• Your rating is calculated from the number of characters that were changed during review.
• In the future we may have different penalties for different types of errors.
• We also do not yet take into account the difficulty of the audio.

About the Displayed Corrections

• For each job, in addition to the ratings, we also show you a set of corrections.
• These corrections are a visual representation of what was changed in review.
• You will note that more characters are highlighted than are actually changed.
• The Corrections are separate from the Ratings.
• You should use the Corrections to learn how to improve your rating.
• Refer to the Insurance Style Guide for precise instructions.

NOTE: This is a pilot program whose details will change over time. We will do our best to award accurate ratings, but can make no promises. We will not be able to examine each disputed rating, but will take them into account as we revise and improve our process.

We welcome your feedback on this program. Please let us know if you have any suggestions.