The call comes amid growing concerns that AI models may become able to inflict serious damage worldwide.