erikwiffin
Joined 17 years ago
Joined 17 years ago
They're still 100% cognizant! And yet.
Mine is less fun, but hopefully more useful https://erikwiffin.github.io/memory-reasoning-eval/
Selling to labs is more than I'm looking for. I'm aiming for a couple hundred dollars so I don't have to finance a Fable vs Sol run out of my own pocket. It would be cool to have my benchmark be one of the ones referenced in a model card!
I think it's interesting, I think other people would find it useful, but I don't want to spend a bunch of money running it against all the frontier models.
What's the best way to reach out to labs like yours to collaborate on something like that? Are there any labs that are more open to submissions from internet randos?
Location: USA
Remote: Yes
Willing to relocate: No
Technologies: Python, Typescript
Résumé/CV: https://erik.wiffin.com/
Email: [email protected]
Fractional Tech Lead with 17 years of tech industry experience.
I work with early stage and bootstrapped companies to help them establish a solid technical foundation. Whether that's building your MVP, your first engineering hire, or setting up an SDLC that gets out of the way so your team can focus on what they do best.1. Don't make it a status update. It's your time, and that's probably not the best use of it. 2. Spend some time figuring out what you want to get out of our 1:1s. If you don't know, tell me that, and I'm happy to work with you to figure it out. 3. End the conversation with next steps/action items. It's easy for me to say something that you interpret as a promise even if I didn't mean it that way and calling out action items explicitly is a good way to keep that from exploding into a huge problem.
I have reports who have told me that they're happy doing what they're doing. I don't see it as a negative at all - they're employees who are quietly getting their job done and I don't have to worry about them leaving for career growth or Peter Principle-ing them into incompetence. It's important that we continue to have 1:1s though. People aren't static, they can change their mind, and I also want to make sure I keep an ear out for little things that are annoying them, and do what I can to make them go away.
erik.wiffin.com
@erikwiffin