This change has raised concerns among contractors, who believe that skipping prompts was intended to improve accuracy by assigning tasks to more knowledgeable evaluators. Google has not commented on these new instructions, which were reportedly communicated to GlobalLogic, the outsourcing firm responsible for evaluating AI-generated output. The move comes after Google shared a preview of Gemini 2.0 earlier this month.
Key takeaways:
- Google allegedly instructed contract workers evaluating Gemini not to skip prompts, regardless of their expertise, according to internal guidance viewed by TechCrunch.
- Previously, contractors could skip prompts outside their expertise, but now they are instructed to rate what they understand and note areas outside their knowledge.
- Contractors can only skip prompts if a significant portion of information is missing or if the content is harmful and requires specific consent forms.
- Google has not responded to requests for comment on these changes.