dangelosaurus

Joined 11 years ago

Karma
142
Submissions
35
Member since
Dec 3
Member of Technical Staff at OpenAI

Previous:

- CTO & Co-founder at Promptfoo https://promptfoo.dev (Acquired)

- VP Engineering at SmileID https://usesmileid.com

- CTO & Co-founder at Arthena https://arthena.com (YC W17 - Acquired)

- Co-founder at Matroid https://www.matroid.com (2015)

Website: https://mldangelo.com

GitHub: https://github.com/mldangelo

LinkedIn: https://www.linkedin.com/in/michaelldangelo/

View on Hacker News

Recent submissions

Comment · 3 months ago
Please email me and I will help fix this.
Comment · 3 months ago
Yes, I think this is an under-appreciated part of the release. I hope people can adapt them to their own workflows. We run A LOT of evals as the Promptfoo team and we've spent billions of tokens fine-tuning them. You can expect more skills as we branch out to other security workflows and further improvements to the codex security prompts.
Comment · 3 months ago
Hello!
Comment · 3 months ago
Thank you, that means a lot. Being able to keep building practical, open-source security tooling was important to us.

Really glad we got to ship this, and there's still a lot we want to improve in Codex Security and in Promptfoo!

Comment · 3 months ago
Comment · 3 months ago
By default, you can sign in with your ChatGPT/Codex account or use an OPENAI_API_KEY. It also does not require cyber registration but it can help if you encounter refusals. If you give it a try, please feel free to message me, I would love your feedback.
Comment · 3 months ago
Agreed! This is near the top of our priority list and we will make it a lot better soon.
Comment · 3 months ago
Comment · 3 months ago
Sorry about that. We hit an authentication issue at launch and have now merged and deployed a fix in 0.1.1:

https://github.com/openai/codex-security/pull/22

One thing worth checking in the meantime: OPENAI_API_KEY or CODEX_API_KEY can override an existing ChatGPT/Codex login. If you're trying to use your ChatGPT login, run this in bash or zsh:

  unset OPENAI_API_KEY CODEX_API_KEY
Then retry your scan.

If it still fails, could you share the exact error and whether you're using ChatGPT login or an API key? Happy to help debug. You can also file an issue in the repo and we'll take a look!

Comment · 3 months ago
Comment · 3 months ago
Comment · 3 months ago
Yeah, you're right. A per-minute rate limit shouldn't kill a scan after a minute, and "partial output was kept" makes it sound like you can pick up where you left off. You can't yet, unfortunately. --max-cost can limit estimated spend, but we still need proper retries and resume. Sorry you spent $13 finding that out. Please send me an email and I'll help make it right.
Comment · 3 months ago
Oof, that's a bad outcome. Half your weekly usage and a 50-minute scan just to get a HEAD error at the end is not acceptable. --max-cost can help limit estimated spend, but that doesn't fix the underlying problem or give you your quota back. We need to handle a changing checkout and partial results much better. Sorry you ran into this. Please send me an email.
Comment · 3 months ago
We are actively working on officially supporting this. Because it's open source it is pretty easy to point a coding agent at it now and switch out the model.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton