Anthropic wants to “figure out how we safely deploy this technology while being able to find and capture misuse," said co-founder Benjamin Mann.