AI memory systems create new risks and control challenges.
Memory is essentially part of our context window. Models now start to keep information about our memory. I asked ChatGPT about using AI in student interviews and it scolded me, saying as a faculty member I should be extremely careful. But even worse, it noted down in my memory that I wanted to use that tool. That’s pretty much a good idea for a big disaster. How do I as an organization ensure that my memory is kept in the correct form? What is the memory you want to capture?
— From Google to Cornell: Rethinking AI Workflows | Lutz Finger | Build AI Podcast 17 · Build AI