Recent submissions

Comment · 1 month ago
Comment · 1 month ago
Any perceived difference isn't due to any technical superiority of vinyl though, more often it's the other way around: you can't dynamically compress audio as much and still have it playable from vinyl, so there's often a different, more dynamic, master/mix going onto the vinyl.

Sighted testing and different audio levels are other common sources of perceived vinyl superiority.

Many people enjoy the ritual of grabbing a vinyl and setting it up for playback, having physical access to coverart and maybe lyrics, which are entirely valid reasons to prefer vinyl, but that isn't audio quality.

Comment · 1 month ago
> Heretic is a tool that removes censorship (aka "safety alignment") from transformer-based language models without expensive post-training. It combines an advanced implementation of directional ablation, also known as "abliteration", with a TPE-based parameter optimizer powered by Optuna.

> This approach enables Heretic to work completely automatically. Heretic finds high-quality abliteration parameters by co-minimizing the number of refusals and the KL divergence from the original model. This results in a decensored model that retains as much of the original model's intelligence as possible. Using Heretic does not require an understanding of transformer internals. In fact, anyone who knows how to run a command-line program can use Heretic to decensor language models.

Abliteration seems to be what Heretic does?

> Now these "abliterated" models all suffer from catastrophic breakage because they are not as simple anymore.

I'm not knowledgeable about each step in the process of making these abliterated models, but some more popular ones with steps after Heretic, seem to improve on the benchmarks tried of the base model:

   arc/c arc/e boolq hswag obkqa piqa  wino

  Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF [instruct mode]
    mxfp8      0.711,0.879,0.910,0.790,0.514,0.823,0.763
    mxfp4      0.701,0.873,0.909,0.786,0.488,0.813,0.759

  Qwen3.6-27B-Instruct: [base, non heretic]
    mxfp8      0.647,0.803,0.910,0.773,0.450,0.806,0.742
https://huggingface.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-...

I'm not seeing any similar benchmarks of the HauhauCS models, at least the ones I checked, so I assumed the opinion is based on your own trials, but then you argue in favour Heretic. Is the based on pre-Heretic abliteration techniques? Which might then not be appliable to this "Proprietary weight-level abliteration developed by the dealignai research team."?

Comment · 1 year ago
Comment · 2 years ago
I see hacspec using secret-integers: "wrapper around integer types for constant-timedness". Does Hacspec/Bertie have assurances about constant-timedness too?
Comment · 2 years ago
Link seems broken.
Comment · 2 years ago
> It is perfectly good enough for the error code enumeration to be statically randomized into hard coded constants.

A comment points out that they aren't randomized:

> The values used were chosen such that it takes a large number of bit flips to change from allowed to denied. Using random values doesn't really protect against this attack.

Comment · 2 years ago
Some data for me:

Nitter: I get all 8 posts in the thread in 18 requests, 207 kB, 169 kB transferred.

X: I only get the first post, 128 requests, 11.45 MB, 2.11 MB transferred.

Comment · 2 years ago
The 608.5 mm² 4090 with 76.3 B transistors isn't too far off from the 814 mm² H100 w 80 B transistors. Seems like mostly more area for memory interfacing?

Assuming they're not selling the 4090 at a loss and being generous that the whole cost is the chip cost, that makes for a $1600 chip. Scaled to the H100 we get $2140. That's a pretty minuscule fraction of a $35k card.

Comment · 2 years ago
That makes sense though, are the chips themselves the bottleneck in production?
Comment · 2 years ago
> 5nm dies are the most expensive part of the whole solution, meaning there is also a 65% pricing advantage (though some of this advantage is offset by more complex packaging and other cheaper dies that go into mi300x as well as more HBM chips).

That doesn't say anything about the fraction of the cost on the finished product though? Those numbers just say it could be something like 2% vs 6% of the cost of the card.

Comment · 2 years ago
Does it matter? Is wafer cost that large of a fraction of the price of these insanely expensive cards?
Comment · 2 years ago
Better output than the smaller llamas in my limited testing, but it's surprisingly slow:

Output generated in 101.74 seconds (0.98 tokens/s, 100 tokens, context 82, seed 532878022)

Output generated in 515.46 seconds (0.99 tokens/s, 511 tokens, context 27, seed 660997525)

Checking nvidia-smi it stalls at ~130W (out of ~470 W max) power usage, ~25% GPU usage and ~10% memory bandwidth usage. There's fairly much traffic on the pci-bus though, and the python process is stable at 100% usage of one core. GPU possibly limited by some thing handled in python? Pausing the GPU-accelerated video-decoding of a twitch stream it get a surprisingly large boost:

Output generated in 380.42 seconds (1.34 tokens/s, 511 tokens, context 26, seed 648992918)

Comment · 2 years ago
> February 08, 2022

They'd need 20 months to manage to notify users?

Comment · 2 years ago
Coming back home and checking 2.2.1 out zfs instantly started spewing write & checksum errors due to #15533. Both this and #15526 seem to have underlying issues from <2.2 that are just more easily triggered now. First one also confirmed on FreeBSD now.

Holding off on 2.2 seems recommended, and if you're keeping critical data on OpenZFS it might be a good idea to give the issues a glance. The 2nd one might have the same underlying solution as an issue that has given me system freezes when closing in on ~90% pool usage using 2.1 on top of LUKS.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton