Discussion about this post

User's avatar
Roy Brander's avatar

Sad!

CPSC grads are all aware of the story of the Mechanical Turk. I got mine just before the "AI Winter" when all the 70s-80s projects collapsed into being of minor commercial value. That's always the test: Money is the measure of all things, in business...

I went to the Master's party for my own T.A., hers being in AI of the time (1983). She said flatly that there was no product on Earth at the time capable of *understanding* a sentence as well as a three-year-old child - that being the point where kids start using whole sentences that connect together. Even then, comprehensible sentences could be generated, but the human was doing all the *understanding*. I finally plodded (and skimmed) through Stephen Wolfram's accessible but deeply detailed explanation of the LLM:

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/

...and it still isn't *understanding*. Wolfram himself sells his "natural language understanding" system, which really does get into that problem. But even his, is maybe getting past age 3, possibly 4, with the connection of words to "meaning".

The current products are mostly creating imitations of saleable material - and "imitations" are not something there's a hot market for, in clothing, music, or words. What LLMs can really pump out, are "corporate bafflegab" with a minimum of meaning, and those jobs will die unlamented. There's too much of such "content" now.

Expand full comment
Erwin Dreessen's avatar

Wonderful piece, Justin, thank you. I just wonder, when current AI "creations" are done mining the "understanding" of previous generations, will they eventually encounter nothing but their own recreations? Corruption of civilization in the second degree?

Expand full comment
5 more comments...