New context window management in dev branch

I just finished new context window management for A0 and I'm surprised by the results. Now A0 can maintain conversation history while focusing on current topic even with limits as low as 400 tokens. Next step is prompt caching support. If you want to try the new version early, you can docker pull frdel/agent-zero-run:development and run it.

5 comments