A new study from Forum AI found that ChatGPT, Gemini, Claude, and Grok provide inaccurate answers when asked about elections and geopolitical topics. The findings raise concerns about AI reliability on critical information.
Four major chatbots—OpenAI's ChatGPT, Google's Gemini, Anthropic's Claude, and xAI's Grok—struggle to deliver fair and accurate responses on elections and news-related questions, according to research by Forum AI.
The startup's survey revealed a pattern of unreliable outputs across the industry's leading AI models when handling sensitive topics like geopolitics and electoral information. This comes as these chatbots gain widespread adoption for news consumption and information retrieval.
Forum AI CEO Campbell Brown attributed the problem to a systemic issue within the AI industry: companies are essentially "grading their own homework" when it comes to evaluating their models' performance. She argued this self-assessment approach lacks the necessary external oversight to catch and correct accuracy problems before deployment.
The findings underscore growing tensions between AI capabilities and real-world reliability. As chatbots become increasingly integrated into how people access news and political information, their propensity for inaccurate answers poses potential risks to informed decision-making, particularly during election cycles.
The study does not specify the exact nature of the inaccuracies—whether chatbots hallucinate entirely false information, present biased perspectives, or conflate multiple events. However, the broad finding suggests all four major models share common accuracy gaps on these high-stakes topics.
Industry observers point to the challenges of training large language models on complex, contextual information with multiple valid interpretations. News and election coverage inherently involves nuance, and chatbots have historically struggled with topics requiring real-time updates or detailed factual precision.
Brown's call for independent evaluation reflects a broader push for third-party auditing of AI systems before public release. As regulators worldwide consider AI governance frameworks, transparency in model performance—particularly on societal topics—has become a key regulatory concern.
The research highlights a critical gap between public perception of chatbot reliability and their actual performance on consequential subjects.
Startups like Altur are deploying AI chatbots to handle debt collection calls, automating a process traditionally done by humans. Y Combinator has backed six debt collection and settlement startups over the past six years.
Following recent earthquakes, Venezuelan developers and citizens deployed AI-powered websites and apps to locate missing persons and coordinate disaster relief as government response lagged.
Prime Minister Anthony Albanese has created a dedicated AI office and committed to protecting Australian creators from copyright infringement by artificial intelligence companies. The government rejected plans to grant tech firms free access to Australian data.