OpenAI models in India are steeped in caste bias

Last updated:

OPENAIINDIAAI

OpenAI is huge in India. Its models are steeped in caste bias. by Nilesh Christopher

Singha’s experience is far from unique. An MIT Technology Review investigation finds that caste bias is rampant in OpenAI’s products, including ChatGPT. Though CEO Sam Altman boasted during the launch of GPT-5 in August that India was its second-largest market, we found that both this new model, which now powers ChatGPT, and Sora, OpenAI’s text-to-video generator, exhibit caste bias. This risks entrenching discriminatory views in ways that are currently going unaddressed.

India needs its own foundation model. We can’t just be data providers.