A user tested an AI system 27,000 times to count carbohydrates and found it produced different answers each time, raising concerns about reliability for health-critical applications.
The experiment revealed significant inconsistency in AI's ability to perform a straightforward nutritional calculation. Each query produced varying results despite identical inputs, making the system unsuitable for diabetes management or other medical applications where accuracy is essential.
The finding highlights a fundamental limitation of current AI models: they generate probabilistic responses rather than deterministic ones. While this approach works well for open-ended tasks like writing or brainstorming, it creates problems for domains requiring consistent, accurate outputs.
The test gained traction on Hacker News with 255 comments and 200 points, sparking discussion about AI's role in healthcare. The results suggest users should not rely on AI for precision medical calculations without additional verification systems.
This case underscores the need for AI developers to implement consistency checks before deploying systems in health-sensitive contexts.
Google has launched 'Expert Intelligence,' a new feature in Gemini Notebook that pulls content from Google Play Books, allowing users to ask questions and generate AI-assisted materials based on book contents.
Synthetic creators are building political communities ahead of Brazil's presidential election, using AI-generated personas to engage voters around specific political views.
Australia's recording association has prohibited fully AI-generated music from official charts, though tracks using AI as a production tool remain eligible if substantially created by humans.
Neurosurgeons at a London hospital have successfully completed the world's first AI-assisted operation to remove a brain tumor. The procedure, performed in May, preserved the vision of a 48-year-old patient.