Activity
Mon
Wed
Fri
Sun
Aug
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
What is this?
Less
More

Memberships

AI Automation Society

423.9k members • Free

AI Automation Agency Hub

328.7k members • Free

AI Automation (A-Z)

164.6k members • $7/month

MyFirstHack | Cybersecurity

93.2k members • $9/month

3 contributions to AI Automation Agency Hub
Shipped my open-source agent testing tool today — would love feedback from this community
Been heads-down on this for a while with my friend Yashrajsinh Rathod, and we finally got it to a clean, tested state today — sharing here first before the wider launch. The problem: testing AI agents sucks. Every test run hits a real LLM API (slow, costs money, and the non-determinism means your CI is flaky by design). Most of the "agent observability" tools out there (Langfuse, Braintrust) solve this by having you send your traces to their cloud and run evals there. What we built instead: Fixtura — record your agent's actual tool calls once (with permission checking baked in), then replay that recording offline, as many times as you want, with zero live API calls. The recordings become literal test fixtures, like snapshot tests, that can gate your CI without touching a live LLM. It's local-first on purpose — your traces never leave your machine unless you want them to. Try it in about 30 seconds: pip install fixtura python quickstart.py GitHub: https://github.com/yash161004/fixtura-core Would genuinely love this community's eyes on it, especially if any of you are building agent products and dealing with flaky non-deterministic tests. What's your current testing setup look like — are you mocking LLM calls, or just eating the cost/latency of hitting the real thing every run? — Yashrajsinh Rathod & Meet Patel
1
0
Shipped my open-source agent testing tool today — would love feedback from this community
Been heads-down on this for a while with my friend Yashrajsinh Rathod, and we finally got it to a clean, tested state today — sharing here first before the wider launch. The problem: testing AI agents sucks. Every test run hits a real LLM API (slow, costs money, and the non-determinism means your CI is flaky by design). Most of the "agent observability" tools out there (Langfuse, Braintrust) solve this by having you send your traces to their cloud and run evals there. What we built instead: Fixtura — record your agent's actual tool calls once (with permission checking baked in), then replay that recording offline, as many times as you want, with zero live API calls. The recordings become literal test fixtures, like snapshot tests, that can gate your CI without touching a live LLM. It's local-first on purpose — your traces never leave your machine unless you want them to. Try it in about 30 seconds: pip install fixtura python quickstart.py GitHub: https://github.com/yash161004/fixtura-core Would genuinely love this community's eyes on it, especially if any of you are building agent products and dealing with flaky non-deterministic tests. What's your current testing setup look like — are you mocking LLM calls, or just eating the cost/latency of hitting the real thing every run? — Yashrajsinh Rathod & Meet Patel
4
0
confused
hey can anyone suggest me where do i learn all tech stuff for starting agency like ai agents ,automations i confused in learning how much i have to learn
1 like • 14d
@Chetan Mishra oh good thanks for suggestion
0 likes • 14d
@Syed Maaz Shah okay thanks
1-3 of 3
Meet Patel
3
25points to level up
@meet-patel-7450
Be greatfull

Active 2h ago
Joined May 8, 2026
Powered by