The two words the AI industry hates more than anything

About this episode

“Stochastic parrots,” a term coined in an influential 2021 paper written by two AI researchers and two computational linguists, essentially holds that large language models are not “intelligent” but are rather systems that output material based on what’s in their training data. Now, while LLMs and technologies described as AI today have become more sophisticated and complex over the last 5 years, the term remains a fundamentally accurate way of describing LLMs. Yet the industry hates it like the plague. AI industry folks absolutely lose their minds over the term, and often bring it up, unprompted, just to try to debunk it again and again. Why does this particular term have a unique capacity to enrage AI industry folks? I had a theory that, even more so than other critiques about shaky financing or dubious functionality, stochastic parrots undercuts the very foundation that the AI boom is built on: That tech companies are building a machine god of infinite power and potential. These firms have relied on narrative to build up and to sell to the world a very expensive, resource-consumptive technology. If it turns out it’s an unthinking system that’s often fallible in predictable way