AI governance
AI Cannot Repair a Corrupted Information Environment
There is a seductive promise embedded in much of the discourse around artificial intelligence and misinformation: that the same technology accused of flooding the world with synthetic text, deepfakes, and algorithmically amplified noise can also be turned around to clean up the mess. Better fact-checking models, AI-powered content moderation, automated detection of manipulated media — these are offered as correctives, as if the information environment were a technical system that broke and can therefore be fixed by better engineering. This framing is wrong, or at least dangerously incomplete. AI cannot repair a corrupted information environment, because the corruption is not primarily a technical failure. It is a social, economic, and institutional one, and no amount of algorithmic filtering addresses its root.
Consider what "corruption" actually means here. It is not simply that false statements circulate — false statements have always circulated. It is that the mechanisms by which societies used to establish shared reference points have eroded: trusted intermediaries, common gatekeepers, shared institutions capable of arbitrating disputes about fact. What replaced them is an attention economy that rewards engagement over accuracy, a fragmented media landscape with no shared arbiter, and a public that has learned, reasonably, to distrust many of the institutions that once served that arbitration function. This is a crisis of trust and incentive structure, not a crisis of information processing. AI systems, however sophisticated, operate inside this same economy. A more accurate fact-checking model does not change what platforms are incentivized to promote, and it does not restore the social trust that made fact-checking authoritative in the first place.
There is also a deeper problem: AI systems are themselves products of the corrupted environment they are meant to fix. Large language models are trained on the same contaminated corpus of human text that includes the propaganda, the SEO spam, the coordinated influence campaigns, and the honest errors alike. They inherit the biases and blind spots of that corpus. Using AI to adjudicate truth claims means asking a system trained on a compromised information supply to certify what counts as reliable — a bit like asking muddy water to filter itself. Even where AI tools genuinely improve at detecting synthetic media or flagging low-quality sources, they do so within an arms race: the same generative capabilities that produce detection tools also produce ever more convincing fabrications, and the fabrication side has structural advantages, since it only needs to fool a detector once, while detection must succeed continuously.
More fundamentally, no technology can substitute for the social achievement of shared epistemic trust. Historically, functioning information environments depended on redundant, overlapping forms of verification: professional norms among journalists, peer review among scientists, legal liability for publishers, reputational stakes for institutions that could be lost through dishonesty. These structures took decades to build and are not restored by inserting a classifier into a content pipeline. Trust is relational and reputational; it is earned through track records and accountability over time, not certified by a badge that says "AI-verified." If anything, offloading the work of verification to opaque automated systems can deepen the very distrust it aims to solve, since people reasonably ask who built the system, what interests it serves, and why they should believe its outputs any more than the disputed claims it evaluates.
None of this means AI is useless in this domain. It can assist human fact-checkers by surfacing patterns at scale, help identify likely synthetic media through technical signatures, and give individuals tools to investigate claims more efficiently. These are meaningful contributions. But they are auxiliary to the real work, not substitutes for it. The real work is institutional and cultural: rebuilding local journalism with sustainable business models, redesigning platform incentives so that accuracy and engagement are not at odds, restoring transparency and accountability to the organizations that shape public discourse, and cultivating media literacy so that people are equipped to evaluate sources rather than outsourcing that judgment entirely to a system, human or artificial.
The temptation to treat information corruption as a problem awaiting a technical fix is understandable — it is far easier to ship a model than to rebuild trust in a newsroom, reform an advertising-driven attention economy, or repair civic institutions that took generations to erode. But treating a social and economic problem as a technical one tends to produce technical solutions that paper over the underlying dysfunction while leaving it fully intact, or in some cases making it worse by adding a veneer of automated authority to a system nobody has good reason to trust. AI can be one tool in a much larger, slower, and more difficult project of institutional repair. It cannot be the repair itself.