What does 'context window' mean and why does my AI forget things mid-conversation?

A context window is the amount of conversation an AI can remember at one time, and when your AI forgets things mid-chat, it's because that window filled up and older messages got pushed out. Every AI model has a limit on how much text it can "see" at once. For example, GPT-4o has a context window of 128,000 tokens, which is roughly 96,000 words. That sounds like a lot, but it fills up faster than you'd think. Here's a concrete example: you're using an AI to help write a 30-page report. You paste the first 10 pages, discuss them, paste the next 10 pages, discuss those, and by the time you paste the final section, the AI has forgotten what was on page 3. It's not broken. It's just out of room. The older text literally falls out of the window. This is why long conversations start to feel repetitive or why the AI suddenly contradicts something it said 20 minutes ago. A practical tip: if you're working on a long project, start a fresh conversation for each major section instead of letting one chat run for hours. Or, before adding new information, ask the AI to summarize what you've covered so far, then paste that summary into a new chat. You'll lose some detail but keep the big picture. For a deeper dive, see our guide on [ChatGPT prompts not working](/blog/chatgpt-prompts-not-working). **Related**: How many words can ChatGPT remember at once? | Why does my AI repeat itself in long conversations?