Four leading artificial intelligence chatbots—ChatGPT, Google Gemini, Claude, and Grok—are struggling to provide accurate and properly sourced answers about elections and geopolitics, according to a new study from Forum AI.
The study examined how OpenAI's ChatGPT, Alphabet Inc.'s Google Gemini, Anthropic's Claude, and xAI's Grok handle questions on sensitive political topics, revealing significant deficiencies across the board.
As the midterm elections approach, the findings raise concerns about the reliability of these widely-used tools for voters seeking information about candidates, policies, and geopolitical events. The inability to accurately source information compounds the problem, leaving users unable to verify claims or trace where responses originate.
Forum AI's research highlights a critical gap in how AI systems handle election-related queries. Chatbots are increasingly used as information sources, particularly by younger demographics, making accuracy in political reporting essential. The struggle with sourcing is particularly troubling—users expect transparency about where information comes from, especially on topics where misinformation poses tangible risks.
The timing is significant. With midterm elections on the horizon, voters may turn to chatbots for quick answers about races, ballot measures, and international issues affecting domestic policy. Inaccurate or unsourced responses could influence decisions made with incomplete or incorrect information.
The study underscores a broader challenge facing the AI industry: these systems, while powerful at pattern recognition and language generation, lack the built-in mechanisms to verify facts in real-time or provide transparent sourcing. Each chatbot relies on training data with knowledge cutoff dates, making recent election developments particularly vulnerable to omission or error.
Developers of these platforms have made various efforts to improve accuracy, including integrating search capabilities and refining training methods. However, Forum AI's findings suggest these efforts remain insufficient for high-stakes applications like political information.
The research serves as a reminder that AI chatbots, despite their sophistication, should not be treated as definitive sources for election information. Users seeking reliable political news should supplement chatbot responses with established news outlets and official election resources.
Startups like Altur are deploying AI chatbots to handle debt collection calls, automating a process traditionally done by humans. Y Combinator has backed six debt collection and settlement startups over the past six years.
Following recent earthquakes, Venezuelan developers and citizens deployed AI-powered websites and apps to locate missing persons and coordinate disaster relief as government response lagged.
Prime Minister Anthony Albanese has created a dedicated AI office and committed to protecting Australian creators from copyright infringement by artificial intelligence companies. The government rejected plans to grant tech firms free access to Australian data.