vellum
Joined 15 years ago
Karma
2,869
Submissions
609
Member since
Mar 30
Recent submissions
Comment · 2 years ago
I had always been curious as to what his thoughts were on generative AI, but he stopped posting a while back. Now, you can find his thoughts in the Dynamicland FAQ. tl;dr - he's not a fan. https://dynamicland.org/2024/FAQ/ https://dynamicland.org/archive/2017/Is_this_the_civilizatio... https://worrydream.com/quotes/?search=kerosene
Comment · 2 years ago
You can try AWS Bedrock or Openrouter if that happens. They both have the Claude API.
Comment · 3 years ago
From OpenAI's RLHF paper[1]: "By default, when we train a PPO model on our API distribution, it suffers from an “alignment tax”, as its performance on several public NLP datasets decreases." On the HELM[2] site, you can see accuracy benchmarks for InstructGPT <OpenAI model> vs baseline models. The InstructGPT models perform worse on a lot of benchmarks.
1 - https://arxiv.org/pdf/2203.02155.pdf
2 - https://crfm.stanford.edu/helm/v0.1.0/?group=question_answer...
Comment · 3 years ago
It's the "alignment tax". From OpenAI's RLHF paper[1]: "By default, when we train a PPO model on our API distribution, it suffers from an “alignment tax”, as its performance on several public NLP datasets decreases." On the HELM[2] site, you can see accuracy benchmarks for InstructGPT <OpenAI model> vs baseline models. The InstructGPT models perform worse on a lot of benchmarks.
1 - https://arxiv.org/pdf/2203.02155.pdf
2 - https://crfm.stanford.edu/helm/v0.1.0/?group=question_answer...
Comment · 4 years ago
Goodhart's law - When a measure becomes a target, it ceases to be a good measure
Comment · 4 years ago
You don't have to care about your job. Most people have about four good hours of work in them. Just do your four hours, and take the rest of the day off. No job is worth burnout.
Comment · 4 years ago
You should find a 100% remote job. If other people are there full time, but you're only there 0-2 days a week, you're never going to be that close with them. You said you're happy when you're at home, but going into the office makes you anxious. So you shouldn't have an issue working at home full time.
Comment · 6 years ago
David Heinemeier Hansson gave a great talk on air quality and touched upon various HVAC systems. One thing that really stuck out, was his claim that you need 80 CFM per person per room.
https://www.youtube.com/watch?v=MRqh8oLY7Ik
Comment · 7 years ago
Have you thought about installing a screen door in your bedroom? You could also look into reinforcing it with chicken wire or hail cloth to keep the cat out.
Comment · 8 years ago
Ordinary Yemenis don't attend cocktail parties at Davos.
Comment · 9 years ago
This lists L1-4 salaries at Google, Facebook, Microsoft, Amazon, LinkedIn, and Twitter.
https://blog.step.com/2016/06/16/more-salaries-twitter-linke...
Comment · 9 years ago
This is a thing with a lot of couples when they retire. They're not used to being around each other 24/7 and drive each other crazy.
http://www.huffingtonpost.com/2013/08/09/divorce-after-50-re...
In Japan, they call it Retired Husband Syndrome, and it affects 60% of older women there.