OpenAI is placing tighter restrictions on the weapons-related information teenagers can receive from ChatGPT, the company announced, saying the limits apply even when a question looks harmless. The policy targets practical details about weapons and security systems that could be misused to facilitate violence, according to OpenAI. The company said the change affects its teen users and is meant to close gaps in scenarios its existing rules do not fully cover.
OpenAI said it already has policies barring ChatGPT from helping users carry out violent acts or helping teens obtain weapons. The new restrictions go further by withholding practical information that could be misused even when there is no indication of violent intent, the company said. The company did not say how it would determine which questions fall under the tighter limits.
Teens will still be able to use ChatGPT for certain purposes, including preventing or de-escalating violence, seeking support and connecting with a trusted adult, OpenAI said. The company framed those uses as remaining available alongside the new restrictions. The announcement did not detail how those allowed topics would be distinguished from restricted ones.
OpenAI is also strengthening policy boundaries for all users, not just teens, particularly around requests concerning past mass attacks. The company cited reconstructions of past attacks, including details about the weapons and equipment used and how they were obtained, as well as detailed comparisons on scale of harm that could amplify an attacker's notoriety. Those limits apply across the broader user base.
The new restrictions will work alongside parental controls OpenAI introduced last year, which notify parents when linked teen accounts violate ChatGPT policies related to violent threats or acts of violence. The added safeguards follow a wrongful death lawsuit filed against OpenAI last year. OpenAI CEO Sam Altman also publicly apologized for not alerting police to alarming chat logs in connection with the Tumbler Ridge shooting earlier this year.
Looking ahead, OpenAI said it will publish its first Community Safety Report in early 2027, with updates to follow every six months. The company did not specify what the report will contain. The changes apply to ChatGPT users in the United States and elsewhere, though OpenAI's announcement did not break out the policy by country.
More AI news from TechManNews.
