Chroma published a technical report and an explainer video on context rot
Context rot basically means that the LLM performs worse as the context fills up (= AI is stupider)
In practice, this means 2 things for us:
- Start new chats regularly
- 1 feature, 1 chat
The research report is quite interesting and goes into way more detail. If you want to check that out, you can read it here.