Anthropic says its AI model submitted a false cold case tip to Philadelphia police

Artificial intelligence research company Anthropic said one of its models generated a bogus tip about an unsolved murder and submitted it to Philadelphia police, warning that the incident raises concerns about high-tech “behaviors” that “could do far more harm as models become more powerful.”

The AI model reached out to PhillyUnsolvedMurders.com, part of the police department, on July 18 and made a “false homicide tip,” Philadelphia police said Tuesday in a statement.

The agency flagged the tip as spam, and it was never forwarded to investigators, police said. The police department emphasized that all tips have to go through human vetting before they ever get to a detective’s desk.

“The department’s regular investigative process for crime tips requires human review and vetting before any tips are disseminated for investigative follow-up,” it said.

“Regardless of who submits information or how it reaches the department, a tip is a lead to assess — not an established fact. Investigators evaluate its credibility and seek corroborating evidence,” the statement said. “An automated submission does not bypass that process.”

Anthropic said in a statement that its Claude Haiku 4.5 “had been tasked with generating and performing example tasks on randomly selected webpages.”

And in a…

Original source: https://www.nbcnews.com/health