Sunday, March 3, 2024

AI Snafu at Google Raises Concern Over Anti-White Bias

Google CEO Sundar Pichai tried to address the company’s Gemini controversy last week, calling the AI app’s problematic responses around race unacceptable and vowing to make structural changes to fix the problem.

Google suspended its Gemini image creation tool last week after it generated embarrassing and offensive results, in some cases declining to depict white people, or inserting photos of women or people of color when prompted to create images of Vikings, Nazis, and the Pope.  The controversy spiraled when Gemini was found to be creating questionable text responses, such as equating Elon Musk’s influence on society with Adolf Hitler’s.

Those comments drew sharp criticisms, especially from conservatives, who accused Google of an anti-white bias. Most companies offering AI tools like Gemini create guardrails to mitigate abuses and to avoid bias, especially in light of other experiences. For instance, image generation tools from companies like OpenAI have been criticized when they created predominately images of white people in professional roles and depicting Black people in stereotypical roles.

In a memo to employees, Pichai wrote:

"I want to address the recent issues with problematic text and image responses in the Gemini app (formerly Bard). I know that some of its responses have offended our users and shown bias – to be clear, that’s completely unacceptable and we got it wrong.

Our teams have been working around the clock to address these issues. We’re already seeing a substantial improvement on a wide range of prompts. No AI is perfect, especially at this emerging stage of the industry’s development, but we know the bar is high for us and we will keep at it for however long it takes. And we’ll review what happened and make sure we fix it at scale.

Our mission to organize the world’s information and make it universally accessible and useful is sacrosanct. We’ve always sought to give users helpful, accurate, and unbiased information in our products. That’s why people trust them. This has to be our approach for all our products, including our emerging AI products.

We’ll be driving a clear set of actions, including structural changes, updated product guidelines, improved launch processes, robust evals and red-teaming, and technical recommendations. We are looking across all of this and will make the necessary changes.

Even as we learn from what went wrong here, we should also build on the product and technical announcements we’ve made in AI over the last several weeks. That includes some foundational advances in our underlying models e.g. our 1 million long-context window breakthrough and our open models, both of which have been well received.

We know what it takes to create great products that are used and beloved by billions of people and businesses, and with our infrastructure and research expertise we have an incredible springboard for the AI wave. Let’s focus on what matters most: building helpful products that are deserving of our users’ trust."

The Gemini controversy has provided fodder for critics on the right, who often accuse tech companies of liberal bias.  But to informed observers, this story isn't about bias. These new developments show that Google made actual technical errors in the fine-tuning of its AI models. The problem is not with the underlying models themselves, but in the software guardrails that sit atop the model.  Nobody really believes Google actually set out to force Gemini to depict the Pope as a woman, or Vikings as Black people, nor did anyone want it to find moral equivalency between Musk and Hitler. This was a failed attempt at instilling less bias and it went awry. The race to develop AI tools has likely forced Google to speed up product development faster than it would have preferred.  While these technical mistakes may be easily fixable,  the reputational damage may not be so easy to fix.

 

No comments: