lsedgwick

Fair, you're probably right in this case.

Please don't paste ChatGPT or BARD answers as HN comments in general? In this specific case, no, LLMs don't reliably know about themselves. They're trained on a big corpus of internet text, then trained by rough reinforcement learning to say and not say certain things about themselves, then given a little more information about themselves in system prompts.

Do you think it's true? I got my hands on the pdf see no trace of it in table of contents or text searches.

There are certainly emergent capabilities that come out of the training process of being able to predict next tokens, and it's shown that LLMs often can solve logic and math problems, riddles, etc. which are not in it's training data because deep in the internal layers of the model it has something resembling logic and reasoning abilities. This can be seen in the "benchmark" results of papers like the GPT-3 and InstructGPT papers, among many others, where they tried pretty hard to test the models against questions which were not part of the training.

This is also shown in the Codex paper, where they trained an LLM to write code and then watched it solve a number of code problems they handwrote originally to make sure the problems could not have been in the training data.

Try it out yourself, make up some little math word problems and ask chatGPT or something.

Of course, advent of code will be much more challenging problems, but to get help with some subcomponents of the problem a motivated participant would likely try to use the most recent, powerful, and advanced models which outperform the results from papers written a few years ago, and outperform the free chatGPT.

I think the right context for thinking about the quoted advice is for a person's education. If true beginners didn't ever handwrite a recursion algorithm, a list sorting algorithm, a CRUD application, an assembly interpreter, a neural net forward pass, etc., because they copied the code from an LLM, would they benefit from that? And if it's true for beginners, is there ever a point in one's learning journey where it stops being true and we don't have to learn or practice anything anymore which can be solved by an LLM, or never have to understand new concepts and tools even though the LLM can work with those concepts and tools for us?

I think there's a both-and answer for the contest. Maybe have one competition where the unenforceable spirit of it is, don't use LLMs for help, and another one where the challenges are just made... quite harder... so that even people who use the LLMs still need to marshal great ingenuity to use them better than others (e.g. the #1 spot is someone who used RAG and chain-of-thought better than the #2 spot, and also had better intuition of what to trust vs challenge from the LLM outputs).

Emissions tests are a poverty tax that play a strong role in punishing people trying to buy affordable old cars and either pushing the demand curve for new cars, or pushing poor people into illegality or carlessness.

hey man, please shoot me an email, I've not quite been in your shoes but would love to talk it out anonymously if you like, or at least just listen if you want to vent more. It's (hidden behind icloud for obvious reasons) [email protected]

as many others now have said, you have great value (in my worldview, you have infinite value as a divinely created being, for that matter, not that I expect you to just believe me when I say that). Losing or never attaining success, money, and glamour does put people into disfavor with much of the world, but when you lose those things I really think it can be an opportunity to look within yourself and discover value that comes from a wholly different frame of reference. I’ve met enough people without great charisma, money, beauty, or power, who have still found contentment and joy (at times, at least; many still go through up and down seasons of mental struggle on a monthly or hourly cycle!) because they have found their own worth in the light of different schemas of valuation. And other people recognize these figures too! People know when they meet someone who is content to authentically be themselves without the esteem that comes from, say, a good job, or anything else. Don’t you sense it sometimes, when you meet someone like that? It’s not just charisma, it’s something better.

pardon the change in topic but what does GP stand for? is is like OP but for a comment thread?

I'm truly sympathetic towards the people affected, especially visa holders. But speaking solely of the macro effects, I have to say, I'm happy this day, stretching from last year to now, has come. We as a community were a very annoying group of people when we were so damn rich and when we thought we were essentially untouchable. And count me in that as well! But a little awareness of layoffs here and (for some people) a little fear of ChatGPT replacement there... well that's a grounding experience. Not to mention the number of people who had sunk into so much ennui and depression over how boring and easy it was. Now a lot of us are jobless and can feel some fire in our bellies again, a time to fight or die.

I guess this makes me a little demoralized about the utility of "anti-big-tech government actions," because to the extent any of these actions succeed, it's probably just sending a clear message to enhance state influence/access of other tech companies. If I get excited (and I want to) because "Amazon might be broken up!!1!", maybe that just means Google finally got the message and decided to put backdoors into <insert platform here> on behalf of <insert agency>.

I think this demonstrates a way in which all centralized power becomes, for good or for ill, partially absorbed into state power. A major country's government will always be able to exert lots of leverage against, e.g. tech companies, whether for legitimate or illegitimate reasons, it matters not which. They can always threaten regulatory or legislative actions which would be annoying or devastating to shareholders. Hence, behind-the-scenes conversations will always have an implicit fact of "please censor as we ask, provide data and backdoored access to which servers we ask, please don't take on the wrong political causes, elsewise there will be consequences."

Goodness knows that if the intelligence community or state law enforcement has ever wanted access to anything in AWS, now of all times would be when they have the easiest time asking for it! Anything to curry favor with someone who can speak a word of support to federal agencies and state officials.

Not to say companies should or shouldn't RTO etc, but the shocking freedom and flexibility of remote work in tech is such a gigantic class marker and insane lifestyle luxury that I'm surprised it's not more often identified a such.

How few people in history have been able to travel to exotic places or visit far-off friends and family, while still making decent money, and do this almost as much as they want (supposing lifestyle and relationships that allow this, which is true for many people). I mean, people in tech who vacation in tropical climes then spend cherished time with parents and siblings and friends living thousands of miles away, and don't worry about running out their vacation time: dozens of weeks of cherished traveling, if that's what you want! Along the way developing fundamentally different types of family relationships or accruing worldly sophistication.

Forget about little medical or technological things that mark a break from the past: lots of people can afford tylenol and iPhones and Spotify. This is a class marker of epic proportion. This is a way of life that Tolstoy ascribed to the very wealthiest of Moscow's aristocratic families and bachelors (most certainly not even all of the aristocratic class).