2h • General discussion
Can AI find security bugs? My Codex test (new long-form)
New long-form is up: Can AI Find Security Bugs? I Tested Codex on My Own App
I gave GPT-6.1 Sol in Codex a tiny app with planted bugs and fake secrets, through my ChatGPT plan. The review was read-only, with no execution or exploitation. It flagged six of eight planted patterns twice, then eight of eight after I revised the app.
The useful part was its reasoning: the original reset value was discarded and the fake mail credential was unused. It also caught a real flaw in something I'd marked safe, so I corrected my answer key. All three runs left the two retained safe decoys alone. One small app and one model give this test clear limits.
The video also walks through OpenAI's reported Linux research and Mozilla's advisory. My opinion: start with an authorized read-only review, check the evidence yourself, then verify a fix with a regression test. Full results and the reusable request: https://www.500xengineer.com/blog/gpt-6-cyber-ai-bug-hunt
Question for you: Has an AI reviewer found a real bug in your code or flagged something safe, and what evidence settled it?
0
0 comments
Can AI find security bugs? My Codex test (new long-form)
skool.com/500xengineer
Learn the newest AI tools for building software, then turn them into income. Career tracks, 18 Claude skills and service playbooks.
Powered by