Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Exclusive: Leaked data exposes a Chinese AI censorship machine

Mar 26, 2025 - techcrunch.com
A leaked database reveals that China has developed an AI system to enhance its censorship capabilities, using a large language model (LLM) trained on 133,000 examples of content considered sensitive by the government. This system, which flags topics related to politics, social issues, and the military, is designed to improve the efficiency and granularity of state-led information control. The dataset, discovered by security researcher NetAskari, was stored on an unsecured Baidu server and includes recent entries up to December 2024. It targets content that could stir social unrest, such as corruption, rural poverty, and Taiwan-related matters, and is intended for "public opinion work" overseen by the Cyberspace Administration of China.

The use of AI in censorship marks a shift from traditional methods that relied on human labor and basic algorithms to block blacklisted terms. This new approach allows for more sophisticated detection of dissent, even subtle criticism, on a large scale. The development is part of a broader trend of authoritarian regimes adopting AI technology for repressive purposes, as evidenced by OpenAI's findings of Chinese entities using LLMs to track anti-government posts and smear dissidents. The Chinese government, however, denies these claims, emphasizing its commitment to ethical AI development.

Key takeaways:

  • China has developed an AI system to enhance its censorship capabilities, using a large language model trained on 133,000 examples of sensitive content.
  • The AI system is designed to automatically flag content related to sensitive topics such as politics, social issues, and military matters, extending beyond traditional censorship methods.
  • The dataset used for training the AI was discovered in an unsecured database, indicating a focus on "public opinion work" aligned with Chinese government goals.
  • Authoritarian regimes, including China, are increasingly leveraging AI technology to improve the efficiency and sophistication of state-led information control and censorship.
View Full Article

Comments (0)

Be the first to comment!