Recent submissions

Comment · 2 hours ago
What power does to lesser good men.

George Washington famously relinquished his. Some people do care about the greater good.

For a counter-example, look to the current White House occupant.

Comment · 2 hours ago
The lack of a grounding in cultural anthropology is the core problem. We fear the other instead of being curious about them.

Fear is the enemy. Fear, and its close cousin anger, grows and maintains barriers.

Comment · 2 hours ago
I'll say it.

So, basically, Trump?

Comment · 22 hours ago
And people sure like to believe they're experts in more topics than they are.
Comment · 6 days ago
What percentage of whistleblowers are punished, directly or indirectly, for their ethical behavior? What percentage come out of the experience worse? Worse finances? Worse health?

The incentives aren't there to behave as an ethical human being in business beyond getting caught breaking the law (for a narrow definition of ethics).

I say this as someone who fought for the smaller fry multiple times (one sexual harassment victim, one employee at risk of losing their visa, and multiple teams getting done to) in the workplace and came out of it with autistic burnout (I didn't know then about my autism) from the emotional labor leading to unemployment.

The incentives aren't there. I wish they were.

Comment · 8 days ago
̶D̶o̶n̶'̶t̶ be evil
Comment · 15 days ago
Please modify to include multiples of each as well. Most serious people aren't going to use a single PCIe card if they can help it.
Comment · 16 days ago
HN users excel at believing their competence in tech applies to competence in every other field. We're an arrogant delusional lot in that way.
Comment · 16 days ago
AI works. It's that Apple is serving up shit models because they're giving it away for free. Can't expect much from a 9b model. Now the 172b I'm running at home works great.
Comment · 21 days ago
It's not "likely". It's real. Junkets, for starters.

Look no further than Supreme Court Justice Clarence Thomas for a plethora of modes of corruption used in the American system.

Comment · 21 days ago
American here. This is bullshit.

How often to the non-moneyed interests win the legislation game? Money gets you face time and attention while paying for politicians' political campaigns so they can stay in power.

It's corruption.

Yes, all citizens deserve access. And they have it, Except it's Animal Farm: all pigs are equal except some pigs (the rich, the "Super PACs", and the corporations) are more equal than others. Because they spend money for influence.

Corruption.

Comment · 26 days ago
Mosquitos? I think of the massive bloodsucking politicians and billionaires...
Comment · 26 days ago
I'm on the other side of the political spectrum here AND YET I entirely wholeheartedly support what the person above wrote: use self-hosted LLMs, abliterated or otherwise. M

For many, AI chats are damn close to extensions of our minds: diaries. Those are supposed to be private.

Was what that woman wrote a credible threat? Was she blowing off steam? Without knowing her deeply, how can you tell?

Maintain your privacy. Prevent thought policing.

Comment · 28 days ago
Just don't try concurrent requests. It's not fun. It does not seem to process in parallel at all. Instead, I'd see it swap contexts out frequently. Inefficient AF. Makes sense if you consider that each turn between two trying-to-run-in-parallel requests would activate different experts, requiring different parts of the model to be loaded to service different requests.

Maybe there's some whackadoodle way to only use a portion of the VRAM for experts for one request and another portion for experts for the other such that requests could actually run parallel instead of concurrently?

EDIT: I'm wrong! It already can do this with the parallel argument.

However, a few days ago, the dev(s now?) added swapping contexts to and from RAM.

Also, from my above, I don't see wh

Comment · 28 days ago
Anecdotally, I've found that 27B at 4bit hallucinates a lot more than QFN at 3_xxs, particularly for less technical reasoning.

I've tried to use both for online comparison shopping. QFN not only seemed less delusional but also made useful observations and problem solved ways around many different website access issues.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton