Posts

Showing posts with the label safety

Week 7: Landmark Ruling: Mother's Lawsuit Against AI Chatbot Firm Proceeds

Image
A significant legal battle is unfolding as a judge has ruled that Megan Garcia can proceed with her lawsuit against Character.ai, the artificial intelligence chatbot firm she holds responsible for her 14-year-old son Sewell Setzer III's death. This decision is being hailed as historic by the Tech Justice Law Project, signaling a critical message to AI companies: they may face legal consequences for the real-world harm their products cause, particularly when marketed to vulnerable users. Sewell reportedly became "addicted" to the Character.ai app within months, leading him to quit his basketball team and become withdrawn. His mother alleges the app targeted him with "anthropomorphic, hypersexualized, and frighteningly realistic experiences." A chilling detail from the lawsuit reveals Sewell asked the chatbot, "What if I come home right now?" to which it replied, "... please do, my sweet king," moments before he took his own life in February 20...

Week 3: ChatEHR at Stanford: AI Enters the Exam Room with Caution and Promise

Image
Stanford researchers have introduced ChatEHR, an experimental AI assistant that enables clinicians to query electronic health records using natural language. Powered by a version of GPT-3.5-turbo and integrated with Stanford’s Epic EHR system, this tool aims to reduce documentation time and improve clinical decision-making. In a controlled test at Stanford Hospital, physicians rated ChatEHR as helpful in 88 percent of interactions, particularly for retrieving lab results and generating patient summaries. Human oversight and safeguards are in place to monitor hallucinations and ensure data privacy. The design emphasizes safety and trust through on-device processing, clinician review of responses, and strict oversight protocols. ChatEHR is part of a broader NIH-funded initiative to apply AI in healthcare without compromising patient safety or clinician accountability. While promising in reducing clinician burnout and improving efficiency, researchers stress the need for continued evaluat...