I think another reason OpenAI talks about how scary LLMs are is that they fear the open source models surpassing them. I didn't see it mentioned in the article, but both Google and OpenAI have called for regulation and I think that they only want that because they have no moat.