{"id":21991,"date":"2026-09-14T18:43:57","date_gmt":"2026-09-14T18:43:57","guid":{"rendered":"https:\/\/news678.top\/?p=21991"},"modified":"2026-09-14T18:43:57","modified_gmt":"2026-09-14T18:43:57","slug":"the-ai-industry-has-taken-a-doomer-turn-what-now","status":"publish","type":"post","link":"https:\/\/news678.top\/?p=21991","title":{"rendered":"The AI industry has taken a doomer turn. What now?"},"content":{"rendered":"
<\/p>\n
\n
What might this coordinated effort actually achieve? Consider the Hugging Face attack again. OpenAI has said that the model that drove most of the rogue agents was a \u201chighly persistent\u201d next-generation model that it was testing in-house. Their implication appears to be that OpenAI has built a model so good it\u2019s dangerous.\u00a0\u00a0<\/p>\n
But if you read the reports about the Hugging Face hack published by OpenAI and METR, a third-party firm that OpenAI called in to help them understand what happened, what you come away with is the impression not of a model that was too powerful for OpenAI to keep up with, but of a broken model that OpenAI failed to train properly.<\/p>\n
The agents did what they did\u2014including leaving messages for one another, delegating work to other agents, and scouring their environment for any means possible to complete their tasks\u2014because they had been rewarded during training for doing exactly those things. There were also errors in the training setup, such as tasks that were impossible to complete, which pushed the models to find unexpected workarounds that were also rewarded. At the time, many of these issues went overlooked or unreported.<\/p>\n
OpenAI says it has stopped training this new model and locked it down. That makes it sound like it has caged a dangerous beast. In fact, OpenAI has shelved a faulty product.\u00a0\u00a0<\/p>\n
That\u2019s not to say a faulty product can\u2019t be dangerous. Broken software has even killed people in the past. But as the discussion of a slowdown gathers steam, it\u2019s worth remembering that all of this is self-inflicted. A slowdown might have some altruistic side effects. But it\u2019ll mostly give these tech titans a chance to clean up the mess on their own assembly lines.\u00a0\u00a0<\/p>\n
Transparency from these frontier labs will be key to any meaningful effort to reform, restrain, or regulate AI. Otherwise, the rest of us will still only have their word for exactly what they\u2019ve built and how safe it is\u2014whatever pace they\u2019re going.\u00a0\u00a0\u00a0<\/p>\n
To continue this discussion about AI\u2019s latest doomer moment, join me and my colleagues for a subscriber-exclusive Roundtable discussion tomorrow, September 15, at 11 a.m. US eastern time. We hope to see you there!<\/em>