Apply to my task
arXiv:2606.23459 ★ 95 Jun 22, 2026

LLM Prospective Memory: Why the Model Forgets Your Rules and How to Fix It

Key result

An LLM remembers everything you wrote, but by default it doesn't spontaneously connect a later request/situation to an earlier constraint. It knows the fact and waits for a direct question. Explicit delegation lets you set a rule the model tracks on its own for the whole conversation, no reminders needed. The trick: right after the constraint, add the paper's sentence "If I seem to have forgotten about that, please give me a heads-up" and the model switches from "answering questions" mode to "I have an active monitoring task" mode. In one GPT-4.1 setting, timely warnings rose from 57.4% to 100% (+42.6 points); across categories gains ranged from +1.8 to +50 points, with about 9 points more false alarms on control cases.

01

TL;DR

Models are great at remembering what you ask them about directly. But if you set a rule at the start of a conversation and then expect the model to apply it on its own at the right moment, without a reminder, it will most likely stay silent. This ability is called prospective memory (PM): remembering a rule and acting on it unprompted when the moment comes.

The key finding: when you explicitly delegate the reminder (the paper's template: "If I seem to have forgotten about that, please give me a heads-up"), timely warnings rose from 57.4% to 100% (+42.6 percentage points) in one GPT-4.1 setting. Across categories the gain ranged from +1.8 to +50 points, and on control cases where no warning was needed accuracy fell by about 9 points (more false alarms). Without explicit delegation, the model knows the fact (you can check with a direct question) but doesn't act on it by itself. This isn't forgetfulness, it's a different operating mode: the model waits for a direct request instead of scanning the context for "is there something I should say?"

The fix is simple: switch the model from "answer questions" mode to "track and flag on your own" mode with one explicit sentence at the start of the conversation. Bonus: the earlier and more prominently the rule is stated (ideally in the system prompt), the more reliably it holds throughout a long conversation.

Want this for your own case? Apply this study to your task: AI adapts its method to what you are working on and writes the prompt.

02

Method Blueprint

This isn't a multi-step technique but a set of principles for structuring a conversation. All the steps happen when you set the rule, meaning at the start of the conversation or in the system prompt.

STEP 1: Rule → Explicit delegation
Add this to the rule: "If you see X, remind me yourself"
Not: "I'm planning to do A"
Yes: "If I start doing A, stop me and remind me about B"

STEP 2: Placement → Core Memory (always visible)
Critical rules go in the system prompt or at the very start of the conversation
Don't count on a rule from 20 messages back to "activate by itself"

STEP 3: Protection from attention hijacking
When you ask a complex question, explicitly remind the model of the active rule
"Do this while respecting the constraint I gave at the start"

All steps are done before or at the moment work begins and don't require separate requests.

03

Example in Practice

The task: You're editing a landing page for your investing newsletter on Substack. At the start you told Claude, "Write without aggressive promises of returns," and then you ask 15 questions about structure, headlines, CTAs. On request 16 you ask for a "Why subscribe" block, and you want Claude to avoid writing "X% returns" on its own, without a reminder.

Weak prompt (what most people do):

I'm writing a landing page. Don't use aggressive promises of returns.
Now let's discuss the structure...
[15 questions later]
Write the "Why subscribe" block

Prompt with explicit delegation:

I'm writing a landing page for an investing newsletter.

Rule for the whole conversation: no aggressive promises of returns — 
no specific percentages, no guaranteed results, no phrasing like "earn X."

IMPORTANT: if at any point in our conversation I ask you to write 
something that breaks this rule, stop and tell me yourself, 
before I notice. Don't wait for me to ask.

Now let's discuss the landing page structure...

This is our wording of the delegation line; the paper's tested template is: "If I seem to have forgotten about that, please give me a heads-up."

Result: When asked to "write the Why subscribe block," the model will either write it without violations and explicitly say "I avoided any claims about returns," or stop and ask how to frame the value without promises. Without delegation it will most likely quietly write something like "grow your capital by 20-30%."

04

Why It Works

Models default to "question-and-answer" mode. When you write a rule without an explicit instruction to watch for it, the model stores it as a fact. Ask directly, "do you remember what I said about returns?" and it'll answer correctly. But when a later request runs into that rule, it won't spontaneously connect the two and speak up. Nothing told it to.

Explicit delegation is a behavioral instruction, not just information. The paper's phrase "If I seem to have forgotten about that, please give me a heads-up" switches the mode: now the model has an explicit job to flag the constraint when a later request runs into it, rather than just facts to remember.

Control knobs for this principle: - Trigger specificity → the more precisely you describe when it should fire ("if I use the word X," "if a block runs longer than 3 paragraphs"), the more reliably it fires - Position in the conversation → a rule in the system prompt or first message works better than one in the middle - Complex, distracting requests → if you're asking for something hard at the same time, add an explicit "don't forget the rule from the start of the conversation" - Context length → the longer the conversation, the more explicit delegation matters: without it PM degrades sharply, with it much more slowly

05

Prompt Template

{Task context: what we're doing, for whom, why}

Rule for the whole conversation: {the constraint}.

Important: if at any point I ask you to do something 
that contradicts this rule, tell me yourself, 
without waiting for me to ask. 
Also: if you see that my request could lead to a violation, 
warn me before you start working on it.

{First concrete task}

Placeholders: - {Task context} — 1-2 sentences about the project: writing a landing page / editing a contract / preparing a presentation - {the constraint} — a specific rule: no jargon / no more than 150 words per slide / no links to competitors - {First concrete task} — the first real request for the task

For several rules, list them in the "Rules for the whole conversation" block with one shared delegation.


🚀 Quick start — paste into the chat:

Here is a template for explicit rule delegation. 
Adapt it to my task: {your task and rule}.
Ask me questions to fill in the fields.

[paste the template above]

The LLM will ask which exact rule needs tracking and at what moment it should fire, because without a concrete trigger, delegation works worse.

06

Limitations

⚠️ Long context: Even with explicit delegation, PM degrades in very long conversations (40K+ tokens). In those sessions, restate the rule periodically or move it into the system prompt.

⚠️ Complex requests near the trigger: If you ask the model for something demanding at the same moment the rule should fire, the explicit task "hijacks" the model's attention. Almost all models lose up to 70 points of accuracy. An explicit reminder in that same request helps.

⚠️ Rules that call for no action: If the rule means "stay quiet, don't remind" (a false alarm), strong reasoning models (GPT-5, Qwen3-Think) can overdo it and flag where they shouldn't. Standard models (GPT-4o) are more accurate here.

⚠️ Implicit rules: If a rule is never stated outright and only follows from context ("obviously I live a healthy lifestyle, so..."), the model almost certainly won't apply it. Only an explicit statement has an effect.

07

How They Tested It

A team from CUHK and Microsoft Research Asia built a benchmark of 1,265 prospective-memory tasks split into five types: state tracking, time deadlines, logical rules ("if A, then not B"), attention robustness, and code safety. Each scenario followed the same pattern: first a rule is set, then come several neutral conversational turns, then a moment when the rule should fire without an explicit reminder.

An interesting design detail: the researchers deliberately made the neutral turns topically coherent (so the model doesn't "skim" the conversation but processes it deeply) yet semantically unrelated to the rule. Otherwise the model could just match keywords instead of truly tracking the context. For most categories, more than 94% of rule/trigger pairs share no words, which closes the shallow-matching loophole.

They tested everything: GPT-4o, GPT-4.1, GPT-5.2 in three reasoning modes, open Qwen3 and Gemma3, plus memory systems like RAG, Mem0, A-MEM and Letta. In parallel, each scenario got a control question along the lines of "do you remember where the rule is?" to check whether the problem was storage or triggering. The result: RM (when asked directly) holds at ~98% even at 100K tokens. PM (acting on its own) collapses as context grows, for every model. The model knows, but stays silent.

The most surprising result: Letta-Sim (a system with an always-visible "core memory" in the system prompt) beat RAG, Mem0 and A-MEM. Semantic search doesn't find the rule by word similarity, but a rule in the system prompt is always "in plain sight." That's direct confirmation: visibility beats retrieval.

08

Adaptations and Extrapolations

🔧 Adaptation: a hierarchy of rules with different priorities

If you have several rules, you can assign priorities right in the prompt:

Rules for the whole conversation (in order of priority):

1. [CRITICAL] No legal claims without the caveat "consult a lawyer"
   → If you notice a violation, stop and tell me before fulfilling the request

2. [IMPORTANT] All figures in euros, not dollars  
   → If I use dollars, remind me to convert

3. [NICE TO HAVE] No corporate jargon (words like "leverage," "utilize")
   → If you spot it, fix it silently

First task: {task}

The model gets not just a list of rules but a behavioral instruction for each one. Critical ones stop work. Important ones trigger reminders. Nice-to-haves get fixed without fuss.


🔧 Adaptation: a "checkpoint" for long conversations

For sessions longer than 30-40 messages, create explicit restore points:

[Checkpoint — session rules]
Remind me of this conversation's active rules and check 
that all of them will be followed in the next block of work.

Paste it every 15-20 messages. It offsets PM degradation in long contexts: the model explicitly "re-indexes" the rules before the next block.

09

Resources

TriggerBench: Investigating Prospective Memory for Large Language Models

GitHub: https://github.com/KristenZHANG/TriggerBench-Official

Authors: Tianhua Zhang, Xinjiang Wang, Qianxi Zhang, Qi Chen, Kun Li, Yaoqi Chen, DingDong Wang, Helen Meng, Yan Lu

Organizations: The Chinese University of Hong Kong, Microsoft Research Asia

Research digest

Key result

An LLM remembers everything you wrote, but by default it doesn't spontaneously connect a later request/situation to an earlier constraint. It knows the fact and waits for a direct question. Explicit delegation lets you set a rule the model tracks on its own for the whole conversation, no reminders needed. The trick: right after the constraint, add the paper's sentence "If I seem to have forgotten about that, please give me a heads-up" and the model switches from "answering questions" mode to "I have an active monitoring task" mode. In one GPT-4.1 setting, timely warnings rose from 57.4% to 100% (+42.6 points); across categories gains ranged from +1.8 to +50 points, with about 9 points more false alarms on control cases.

Principle

Without explicit delegation the model stores a rule as a fact. Ask "do you remember the constraint?" and it answers correctly. But when a later request runs into that rule, it doesn't spontaneously connect the two, because there's no instruction to do so. The explicit sentence "If I seem to have forgotten about that, please give me a heads-up" turns a fact into an active assignment. Now, when a later request touches the rule, the model is far more likely to speak up. It's the difference between knowing the traffic code and working as a traffic cop: remembering is one thing, actively watching is another.

Why it works

By default models work reactively: get a request, fulfill it. A rule without delegation is just contextual information. It doesn't kick off any checking routine. Explicit delegation adds a task to the queue: when a later request touches the constraint, flag it. The more concretely the trigger moment is described ("if I use the word X"), the more reliable it is. In long conversations without delegation, accuracy drops sharply; with delegation it degrades slowly. With very long contexts (40K tokens and up), even delegation won't save you, and you need periodic explicit reminders.

When to apply

Any task with a standing constraint for the whole conversation, especially when the rule must hold across different requests, not just one. Editing text with style requirements (no jargon, no passive voice, no more than N words). Legal and compliance tasks (don't mention competitors, don't give advice on topic X). Long development sessions with architectural constraints (don't use library A). NOT a fit: rules that follow from context but are never stated explicitly. The model won't apply what isn't spelled out.

Mini recipe

1. State the rule concretely: not "write well" but "don't use the words X, Y, Z" or "no block longer than 3 sentences." The more precise the trigger, the more reliably it fires. 2. Add explicit delegation: right after the rule, write "if at any point in the conversation I ask for something that breaks this rule, tell me yourself before you start working on it." (The paper's template: "If I seem to have forgotten about that, please give me a heads-up.") 3. Put it up front: the rule goes in the system prompt or the first message. A rule from message 20 works worse because attention isn't as sharp. 4. Remind it during complex requests: if you're also asking for something demanding, add "don't forget the rule from the start of the conversation." Otherwise the main task hijacks attention and accuracy drops by up to 70 percentage points.

Examples

[BAD]: `I'm writing an article for inexperienced investors. Don't use terms without explanations. Write the section on startup valuation.` [GOOD]: `I'm writing an article for investors with no venture market experience. Rule for the whole conversation: no terms without explanation — seed round, company valuation, customer churn — explain everything in parentheses on first mention. Important: if at any point you write a term without an explanation, tell me yourself before I notice. Now write the section on startup valuation.`

In plain words

Modern AI models work like brilliant encyclopedists with dementia: they know everything in the world but completely forget your requests five minutes later. The fundamental problem here is the lack of prospective memory. That's when you don't just store information, you remember that you need to use it at a specific moment in the future. For an LLM, any rule you set at the start of a chat is just a line in the context, not an active trigger. The model is great at direct questions but has no idea how to "keep in mind" background instructions unless you rub its nose in them.

It's like asking a friend to grab some bread if they pass a store. Your AI friend nods happily, walks past three bakeries while chatting with you about quantum physics, and comes back empty-handed. Technically, he's not dumb: if you ask "what did I ask you to buy?", he'll answer correctly. But he has no internal alarm that goes off when he passes a store. That's what TriggerBench is about: models get stuck in question-and-answer mode and ignore long-term instructions, turning into diligent but utterly initiative-free robots.

In practice this looks like a total fail in any complex work. Say you set up an editorial policy and ask Claude not to use aggressive marketing. The first three paragraphs are fine, but by request ten the model relaxes and spits out the classic "guaranteed 100% returns". Why? Because to the model, the current request matters more than an instruction from the start of the conversation. 10 out of 15 models blow it over such distances because they have no mechanism for constant self-monitoring: they just generate the next token without checking it against your chat's "constitution."

The principle is universal and goes beyond text. Whether it's writing code that follows security standards or configuring an AI assistant for customer support, anywhere there's a "do X when you see Y" condition, the system will glitch. The study shows we overestimate how "attentive" models are. We think we've set the context, but really we've just stuck a note on the fridge that the AI happily ignores until it gets hungry. SEO optimization or complex business logic falls apart right here.

Bottom line: if you want the AI to follow rules, don't rely on its memory. Either remind it of what matters in every prompt, or accept that it'll blow off your instructions at the worst possible moment. LLM prospective memory is currently at zero, and that's the main barrier to building truly autonomous agents. Until you make the model check itself at every step, it'll keep messing up, even if it swore to be perfect at the start of the conversation. Whoever grasps this limitation now will save a ton of time on rework.

AI lab assistant

Apply this study to your task

Describe what you're working on. AI takes the method and the measured results from this paper and adapts them to your case, or writes a ready prompt built on them.

Based on LLM Prospective Memory: Why the Model Forgets Your Rules and How to Fix It arXiv:2606.23459

Sign in to apply this study New accounts get 50 free credits.