Earn money with your generative AI skills – Browse jobs

Upwork is hiring a Review and classify text content on a weekly basis

Review and classify text content on a weekly basis

Upwork  ·  US  ·  $10k/yr - $25k/yr
2 months ago

4 applicants

Using generative AI, we create intriguing tidbits related to publisher's original content in order to hold audience attention longer.

Our system generates thousands of tidbits per months, consisting of 1-3 paragraphs varying in length between 500-1500 characters.

Because generative AI is prone to errors and artifacts, we are looking for one or more freelancers to help us monitor the output of our system.

The task is simple. We will give you access to a Google Sheets. In it, you will find rows of data, including the original text and our software's annotation of that text. You will review our annotation and classify it as one of several categories, such as:

- OK

- Fluffy

- Inaccurate

- Repetitive

- Offensive

We will provide you with examples of input/output pairs and their classification so you can get up to speed on the judgment call we are asking you to perform.

We'll give you a new sheet each week, and you will classify a few hundred rows at a time.

LMK if you have any questions! If you are submitting a proposal, include your answer to this screening question.


1. Below is original text and an AI-generated annotation. How would you classify that annotation?

Original Text: This is consistent with the plethora of findings published about the health benefits of a Mediterranean diet, which is rich in fruits, vegetables, oily fish, and olive oil. Another study examining the blood and urine samples of over 600 elderly people over two decades found that the Mediterranean diet contributed to living a longer life. It has also been implicated in stopping Alzheimer’s disease, preventing frailty in the elderly, promoting healthy aging, and fighting off depression.

Annotation: Did you know that music has been used to enhance the flavor of olive oil? Several studies have found that playing certain types of music, such as classical or baroque, during the olive oil production process can actually improve the taste and quality of the oil. The vibrations and frequencies of the music are believed to stimulate the molecules in the oil, creating a smoother and more harmonious flavor. So, the next time you're enjoying a drizzle of olive oil on your salad or pasta, consider playing some soothing tunes in the background to enhance your culinary experience.


B: Fluffy

C: Inaccurate

D: Repetitive

E: Offensive

2. Why did you choose that classification?

Job is closed

This job is already closed and no longer accepting applicants, sorry.