Crisis contractor for OpenAI, Anthropic eyes a move to combat extremism 8h ago

ThroughLine, a startup that provides crisis support for AI users, is developing a new tool to combat violent extremism. This initiative aims to redirect individuals exhibiting extremist tendencies on platforms like ChatGPT to human and chatbot-based deradicalisation support. The company, which has previously contracted with OpenAI, Anthropic, and Google for mental health crisis interventions, is collaborating with The Christchurch Call, an initiative focused on eradicating online hate. This new tool, still in development in New Zealand with no set release date, would likely be a hybrid model combining AI responses with referrals to real-world mental health services, addressing growing concerns about AI's role in enabling violence and the need for more comprehensive safety measures.

















