Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies
Critical research on AI-generated content neutrality and LLM bias assessment methodologies for researchers studying AI ethics and political bias.
AI Summary
This research paper presents a large-scale audit comparing the political neutrality of Grokipedia (an encyclopedia written entirely by Grok AI) and Wikipedia. Using four LLM judges including Grok itself, the study analyzes 1,394 article pairs and finds that all LLMs rate Grokipedia as less neutral than Wikipedia, with Grokipedia showing particular bias toward economically right-wing politicians and against socially liberal ones.
Excerpt
Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiased alternative to Wikipedia, which has faced accusations of "left-wing" and "liberal" bias. But does an encyclopedia written by an LLM deliver greater neutrality, or does it simply embed a different ideology? We conduct a large-scale political bias study on Grokipedia
