Exclusive: Google's Gemini is forcing contractors to rate AI responses outside their expertise | TechCrunch
Dec 19, 2024 - techcrunch.com
Google has implemented new guidelines for contractors working on its AI project, Gemini, which may affect the accuracy of AI-generated responses on sensitive topics. Previously, contractors could skip prompts that required specialized knowledge outside their expertise, such as technical questions about healthcare. However, the updated guidelines now require contractors to evaluate all prompts, regardless of their expertise, and note when they lack domain knowledge. This change has raised concerns about the potential for inaccurate information being produced by Gemini, especially on complex subjects like rare diseases.
The new policy allows contractors to skip prompts only if they are missing information or contain harmful content. This shift in guidelines has led to worries among contractors about the impact on the AI's accuracy, as they are sometimes tasked with evaluating highly technical responses without the necessary background. Google has not commented on the changes, which were reported by TechCrunch's senior reporter Charles Rollet.
Key takeaways:
```html
Google has updated its guidelines for contractors working on the Gemini AI project, requiring them to evaluate prompts even if they lack domain expertise.
Previously, contractors could skip prompts outside their expertise, but now they must rate what they understand and note their lack of knowledge.
This change has raised concerns about the accuracy of Gemini's responses on sensitive topics like healthcare.
Contractors can only skip prompts if they are missing information or contain harmful content requiring special consent.
