Tharre
Joined 12 years ago
Joined 12 years ago
I don't have a clue on what the real cost to inference providers comes out to, but it seems really weird that there would be such a big gap, in what should be a pretty competitive market.
Do they just set a super low caching time and hope that drops effective cache rates low enough? Do all other providers somehow overcharge by that much? Are they just going to sell it as a loss leader?
Best hypothesis I can come up with is to somehow make the AI companies look bad, but they seem to be doing an excellent job at that themselves already by scraping everyone hundreds of times per hour over and over.
If it is a deliberate choice, it's a really, really dumb one.
Active cables are a different story of course, but that's the same for HDMI cables.
But for coding in a harness? In my experience it's unusable even for small projects. It just gets hard stuck at every little problem, wasting hundreds of thousands of tokens trying to make a convoluted solution work instead of doing the obvious thing. Or it will spend hours trying to reason through a fairly simple code flow, incrementally adding debug print statements, only to get confused by the output and then editing completely unrelated code that it convinced itself is the problem.
I've tried instead giving Sonnet the problem description and code and have it come up with a detailed plan that Qwen should implement, but doing that actually consumes a significant amount of tokens compared to just telling it to implement everything, and the results are honestly not that much better. There are just too often subtle issues with the plan that Qwen doesn't recognize when implementing, but make the resulting solution it comes up with unusable.
Europe is heading into the worst energy crisis since at least the 1970s, possibly worse. And yet very little is happening to prepare for it. Definitely some fun times ahead.
First, although I don't disagree with that being how it should work, in a world where everyone relies on npm, cargo, etc. to handle dependencies this scenario is not realistic.
Second and more importantly, it doesn't really change much if it's listed in the sources or not. You can patch a startup file to download something as soon as the program is executed, including checks if it's currently running in a virtual environment. You cannot statically detect that the PKGBUILD contains something like that, antivirus software has been trying to do just that for decades and their detection is still basically useless.
> A less than 100% reliable mechanism sure beats the current situation which is "wait for users report on the forum that they have been pwn3d".
The current situation is users are expected to review PKGBUILDs before they install them. And you're ignoring that implementing any mechanism has a cost. I don't know if it's worth it or not, but it's not unrealistic that it would be a ton of effort for no barely any gain.
Huh? No they don't. I'm not sure what part of the attack your misunderstood, but most people are going to be completely unaffected by this. None of the infrastructure or anything like that got compromised. I updated my AUR packages 2 hours ago, and didn't get served any malware.
Again, there's probably some kind of malware on npmjs at any given time. You don't just shutdown the entire server because of that, that's madness.
> install=toggldesktop-bin-deps.install
And the toggldesktop-bin-deps.install contains this:
> post_install() {{
> cd /tmp
> bun add axios uuid ora js-digest
> }}
Seeing any install hook download anything from the web should immediately raise alarms when reviewing, even before you checkout what packages it actually installs.
Do you not realize how crazy of an request that is?
1 - degradation: assuming the 15 years battery life / 10.000 cycles number from the datasheet is accurate, and that the manufacturer considers 70% capacity end-of-life, this pushes the payback time from 11.1 to 12.7 years.
2 - The article calculates the savings with:
> daily saving = 4.5 × expensive price − 5 × cheap price
but this is wrong because it assumes that grid charges fully cancel out. The article generally does a poor job at explaining this, but essentially it proposes you overbuy electricity when it's cheap and use it when it's expensive. The difference of those two, €0.133/kWh - €0.041/kWh is much smaller then the average electricity price of €0.3869/kWh because the latter also includes taxes and grid charges. So with 90% efficiency they end up with the formula above, but completely ignore the fact that from the grid's point of view, the total electricity consumption increased. On the flipside, it's also taking EPEX prices directly, pre-VAT, so you actually save 19% more then the difference 0.133 - 0.041 = 0.092. So the actual formula should be:
> daily saving = 1.19 × (5×0.9 × expensive price − 5 × cheap price) − 5 × (1−0.9) × grid charges
At a average rate of 21 cents/kWh for total grid costs (including VAT) that comes out to a payback time of 13.71 years.
So yeah, buying batteries alone doesn't make sense. You need solar or wind to charge them, so you actually avoid the grid charges. So that instead of saving 10 cents you save 40.