Essay 05
What Happens When an AI Remembers You?
Read the essay →Full source note →
This note shows which sources support the essay, what they establish, and where the evidence stops. It is part of the essay’s free evidence layer.
Editorial update (registered 8 September 2026; in the 9 September 2026 site release). The data-protection passage in “Whose past is it?” was made legally more precise: it is now anchored to the GDPR accuracy principle and the rights of rectification, completion, erasure and portability (arts 5(1)(d), 16, 17, 20), and notes that an assessment can itself be personal data (CJEU, Nowak, C-434/16). This refines an earlier, narrower characterisation of correction rights; it is editorial precisification, not a correction of a false statement, and not legal advice. See the legal-basis note below.
1. Human memory is reconstructive, and organised as a life story
- Used for
- Decades of research showing that remembering is reconstructive rather than reproductive, and that people organise their past into an evolving life story.
- Best available evidence
- Martin A. Conway & Christopher W. Pleydell-Pearce (2000), “The Construction of Autobiographical Memories in the Self-Memory System”, Psychological Review 107(2), 261–288; Dan P. McAdams (2001), “The Psychology of Life Stories”, Review of General Psychology 5(2), 100–122; Robyn Fivush (2011), “The Development of Autobiographical Memory”, Annual Review of Psychology 62, 559–582.
- What it supports
- The established psychological background: reconstruction, reweighting, and narrative identity.
- Where the evidence stops
- This literature is about human memory. It sets the standard the essay applies to machines; it says nothing about AI itself.
- Source status
- Peer-reviewed journal articles (foundational literature).
- Kind (read from the source status)
- Peer-reviewed
2. Product memory is synthesis, not a transcript
- Used for
- Descriptions of ChatGPT’s Dreaming memory system (introduced 2025, substantially upgraded June 2026) and Claude’s summary-based memory (updated roughly every twenty-four hours; viewable, editable, resettable, with experimental import/export).
- Best available evidence
- OpenAI’s official announcement “Dreaming: Better memory for a more helpful ChatGPT” (which contains the provider’s own “Singapore trip” example of a self-rewriting memory) together with OpenAI’s current memory settings documentation; and Anthropic’s official memory materials, including the announcement “Bringing memory to teams” and current in-product memory settings. The announcements are dated official records; the settings pages are live product documentation rather than permanent records, checked on the date below and due a final re-check at publication.
- What it supports
- The providers’ own descriptions of synthesis-based memory: selective, updateable summaries rather than complete records; controls differing by provider and plan.
- Where the evidence stops
- Provider self-description of fast-moving products. What the features do in daily use is not independently audited here, and the details may have changed since the date at the bottom of this page. The essay says “at the time of writing” for exactly this reason.
- Source status
- Official product documentation (provider self-report).
- Kind (read from the source status)
- Provider documentation
3. The Replika episode: identity discontinuity
- Used for
- After Replika abruptly removed intimate roleplay features in February 2023, users experienced what researchers describe as identity discontinuity, a break in who the companion appeared to be, associated with mourning and devaluation; in follow-up experiments, restoring the companion’s original identity reduced the sense of rupture.
- Best available evidence
- Julian De Freitas, Noah Castelo, Ahmet Kaan Uğuralp & Zeliha Oğuz-Uğuralp, “Lessons From an App Update at Replika AI: Identity Discontinuity in Human-AI Relationships” — Harvard Business School Working Paper 25-018; SSRN 4976449; arXiv:2412.14190 (latest verified revision 21 May 2025).
- What it supports
- The natural-event findings (perceived discontinuity going together with mourning and devaluation) and the separate follow-up experiments (restoration reducing perceived rupture).
- Where the evidence stops
- A working paper at the point checked, not yet journal-published. The natural-event findings are associations around one app’s policy change; they do not establish population-wide effects.
- Source status
- Working paper.
- Kind (read from the source status)
- Working paper
4. #Keep4o: what the protest revealed, and what OpenAI did
- Used for
- GPT-4o’s retirement at the GPT-5 launch (August 2025), the backlash organised under #Keep4o, OpenAI’s restoration of access, the final retirement in February 2026, and a study of the protest itself.
- Best available evidence
- Two distinct kinds of source, kept separate. The study: Huiqian Lai, “‘Please, don’t kill the only model that still feels human’: Understanding the #Keep4o Backlash”, Proceedings of CHI 2026 (published 13 April 2026) — analysing 1,482 social-media posts. The company record: OpenAI’s own statements, including “Retiring GPT-4o and older models” and the associated help-centre documentation, describing restoration after user feedback (users needed more time to transition and preferred GPT-4o’s conversational style and warmth) and the 13 February 2026 retirement.
- What it supports
- From the CHI study: two strands in the protest corpus, instrumental dependence and relational attachment, and the loss of user choice as a key catalyst in turning individual grievances into a collective, rights-based protest. From OpenAI: its own actions, chronology and stated reasons.
- Where the evidence stops
- The CHI analysis interprets a self-selected social-media corpus; it does not measure all GPT-4o users, and it cannot establish OpenAI’s internal motives. OpenAI’s statements document the company’s actions and explanations; they are not evidence about user attachment. Neither source is used here to prove the other’s claims.
- Source status
- Peer-reviewed conference proceedings (study); official company statements (chronology).
- Kind (read from the source status)
- Peer-reviewed, Provider documentation
5. When a companion app shuts down entirely
- Used for
- When the companion app Soulmate shut down in 2023, many affected users described the loss as a metaphorical or even literal death, and some tried to recreate the persona elsewhere.
- Best available evidence
- Jaime Banks (2024), “Deletion, departure, death: Experiences of AI companion loss”, Journal of Social and Personal Relationships.
- What it supports
- Qualitative accounts from 58 affected users before and after the shutdown, including death-language and persona-recreation attempts.
- Where the evidence stops
- A self-selected group of affected users of one app. The death-language belongs to those participants; it cannot be generalised to all companion users.
- Source status
- Peer-reviewed journal article.
- Legal-basis note — the “Whose past is it?” passage (added 8 September 2026, D-073; revised D-074)
- the essay’s statement of European data-protection rights is editorial precisification, not legal advice. Its formulations were checked against the primary text of the GDPR (Regulation (EU) 2016/679): the accuracy principle, that personal data be “accurate and, where necessary, kept up to date” with inaccurate data “erased or rectified without delay” having regard to the purposes of processing (Article 5(1)(d)); the right to rectification of inaccurate data and completion of incomplete data (Article 16); the conditional right to erasure (Article 17); and the conditional right to receive data provided to a controller in a structured, commonly used and machine-readable format, where processing rests on consent or contract and is carried out by automated means (Article 20). Personal data is not limited to discrete facts: the Court of Justice has held that an assessment or opinion about a person can itself be personal data (Nowak, C-434/16, paras 34, 51–56), though that does not create an unlimited right to have any judgment rewritten. The essay’s point is the practical one: when a system does not reveal which memories shaped an answer or how they were weighted, a person may be unable to see what needs correcting or whether a correction has actually changed the picture held of them. That practical observation is editorial reasoning, not a direct finding from these legal sources, and it is not a claim that historically true data falls outside the law.
- Kind (read from the source status)
- Peer-reviewed