The Eliza Effect: We Keep Mistaking Fluency for Understanding

In the 1960s, Joseph Weizenbaum wrote ELIZA, a crude program that mirrored users' sentences back as questions. Its secretary-type users reportedly asked to be left alone with it. Weizenbaum was alarmed, and the alarm was the right reaction, though not for the reason people usually give. The eerie part was never the machine's cleverness, which was nil. It was our eagerness to do the understanding ourselves. We hear a reply that sounds attentive and we supply the attention, the intent, the someone behind the words. This habit is older than computing. We read faces into clouds and motives into weather. What's new is that the outputs now sustain the illusion for hours, in full sentences, without visibly tiring. The real question is not whether people can be fooled by a machine but why a conversational surface so reliably substitutes for evidence of a mind. Our standards for sincerity were built for creatures who could not produce fluent speech without something behind it. That assumption has quietly expired, and we have not noticed.