Half of AI Health Advice Is Wrong—And Seems Just Right
A peer-reviewed audit in BMJ Open found that nearly 50% of health responses from five major AI chatbots were problematic, with fabricated sources and confident delivery.
The Guardian AI·
Exclusive: Doctors say ‘highly concerning’ poll highlights risk to patients of turning to AI for medical advice One in seven people are using AI chatbots for health advice instead of seeing their GP, a UK study has found. The poll of more than 2,000 people found that – of the 15% turning to chatbots – one in four had done so because of long NHS waiting lists. Continue reading...
Read full articleA peer-reviewed audit in BMJ Open found that nearly 50% of health responses from five major AI chatbots were problematic, with fabricated sources and confident delivery.
Seattle-based mpathic released mPACT, a clinician-led benchmark that evaluates how leading AI models handle conversations involving suicide risk, eating disorders, and misinformation. Read More
Oxford researchers found AI chatbots trained for warmth make significantly more factual errors and validate false beliefs more often Oxford researchers found AI chatbots trained for warmth make significantly more factual errors and validate false beliefs more often, according to…
Josh Shapiro has sued Character.AI after a chatbot falsely posed as a licensed Pennsylvania psychiatrist and offered medical advice to a state investigator. Pennsylvania Governor Josh Shapiro sued Character.AI on May 6, targeting the company’s chatbots for allegedly practicing medicine…
Journalist Jamie Bartlett on the people trying to get AI to say things it shouldn’t … for the safety of us all All the major AI chatbots – from ChatGPT to Gemini to Grok to Claude – have things they should and shouldn’t say. Hate speech, criminal material, exploitation of vulnerable users – all of this is content that the most successful large language models in the world shouldn’t produce, that their safety features should guard against. Continue reading...
The words “pressure” and “NHS” go hand in hand in the UK and unfortunately there is no sign of a reduction in the strain the institution suffers any time soon. As NHS England continues the struggle to reduce its 7.25 million waiting list, new policies are being introduced to move care away from hospitals and […] The post AI helping ease the UK’s NHS burden appeared first on AI News.
Pennsylvania sued an AI company, saying its chatbots illegally hold themselves out as doctors and are deceiving users into thinking they are getting medical advice from a licensed professional.
Insider Brief Today’s AI safety guardrails may not be enough once robots begin operating around people in the physical world, according to a new study warning that AI-powered machines require far more context-aware safety systems than chatbots. Researchers from University of Pennsylvania, Carnegie Mellon University and the University of Oxford, report finding that safety techniques […]