Subject: Re: A Bursting Bubble Would Be Great for A.I.
Is that really how they work? If they can hold a conversation, they must remember what was said previously.

Slight overgeneralization:
They do remember, but only within their "context windows"...back (say) a few hundred words or a few thousand, depending on the product. And at the end of the session it evaporates. They all have anterograde amnesia.

One can add some "icing" on the training after a foundational model is built, as another one-time step, but they don't generally learn or remember as they run.

Jim