zx76

I see a lot of people writing about how expensive the hardware to run these local models is - but see no mentions of the Intel Arc Pro B50/B60/B70 which seem like decent value if you're not interested in Apple kit (as much as anything can be decent value in the current status quo).

I just got a B70 with 32GB RAM for the equivalent of $1200 (incl. sales tax and import duties to my non-US location, so presumably it could be cheaper elsewhere). The memory bandwidth is 608 GB/s. For M5 Max (32-core GPU) it's 460 GB/s and for M5 Max (40-core GPU) it's 614 GB/s. A 3090 is still faster at ~900 GB/s but you're getting 32GB VRAM for a lot less than equivalent Nvidia cards. It's about 1/3 the bandwidth of a 5090 for 1/3 the cost, but with the same 32GB VRAM. If you're interested in being able to run bigger quants with some context and stay on a lower budget then it's an appealing trade off.

I'm still exploring using these local models so don't want to spend the equivalent of $5 000 - $10 000 just to test it out. I don't mind slightly slower perf to do some experimentation more affordably.

I actually got an B50 16GB (with meager 70w TDP!) first to test an Intel card with my stack - it worked easily with Ubuntu & Vulkan. I'd read a lot about hassles and people writing them off as unusable but it seems like these are often with SYCL which doesn't even seem to outperform vulkan and so why bother? (The B50 was just $370 inclusive tax and duties). Literally `apt install` the vulkan libraries and it worked with default xe driver in 26.04 and the vulkan build of llama.cpp. The SR-IOV PF/VF also just works with qemu/kvm, no tricks required. Since I got it fwupdmgr has updated the firmware twice so Intel is presumably actually trying to support these products.

I saw another article - can't find it now - with statements to the effect that transmission of Andes strain hantavirus is typically only between very close contacts, like amongst partners. But already the original couple who traveled in the endemic area of the Andes virus prior to boarding the ship have apparently spread it to another couple on the ship, the ship's doctor, 2 crew members and additionally the person who has tested as positive in Switzerland.

Unfortunately it seems like it, our service has lost a portion of our Cloudflare connectivity. We use their tunnels functionality.

Additionally, it looks like Pingdom/Solarwinds authentication is affected too - not a great look for a service in that category.

Yes. Most houses in SA have electrically heated water stored in a tank called a geyser. There are other options - some apartment complexes have central heat pump hot water, some houses have on demand heating via gas - but the most common is something like a 100/150/200 litre insulated steel tank in the roof that stores hot water and regulates it to 60 degrees C via thermostat.

Long comments like this often look like they're going to present a serious diatribe but this is actually a balanced take.

The line "The two mega coal power stations have been beset with issues as well" even radically undersells just how much of a debacle these two power stations have been. They were supposed to be the 8th/9th biggest coal stations in the world & accurately sized to solve the pending shortages in time, the major contracts went to legitimate companies like Alstom, GE & Hitachi. They were supposed to take approx. 5 years from 2007 and cost a reasonable approx. R30 billion each.

What's actually happened is that 15 years later neither is fully operational and the money spent has crossed 10x the original plans. The parts of the stations that currently do work are hamstrung by massive and debilitating design flaws that regularly cause trips or bigger issues (e.g. a smoke stack collapse last month) and there is no clear end for the construction in site even after all this time & money. And these aren't complex nuclear plants - these are just standard coal power stations. How to build them is quite well understood by now!

It's a combination of sustained and massive corruption (every now and then the current administration finds a few extra billion to recoup from a corrupt contractor), poor original designs that have complicated every subsequent step in the waterfall chart and finally unfortunate incompetence (for instance one of the 6 units at Medupi was entirely blown up after hydrogen wasn't vented before maintenance. The entire generator room must now be replaced with new parts from France at the cost of multiple billions of rands and over a year and a half of additional delay).

Finally, w.r.t. the reforms mention in parent comment's final line - I think they have a chance. South Africa has previously had a radically regulated energy sector. Basically you couldn't generate your own power, period. But due to the pressing political weight of the current situation there have been increasing steps away from the ideological commitment to exclusively state run coal powered grid. Large energy users and businesses can now do paperwork for approval to run their own multi-megawatt stations and basically every big factory, mine, mill etc. is now doing this to varying degrees. The big mining houses especially will spend a lot of money building their own infrastructure now. Between allowing the grid to buy private power (a lot of which is affordably priced renewable energy) and a lot of heavy demand starting to make its own power I think there's a fair chance things will stabilize in the next 2 years. The big question is electoral conferences and the next elections. If EFF wins meaningful electoral power there is a strong chance SA will go the route of Venezuela quicker than people think - and I say that as someone who is very committed to staying here and doesn't subscribe to most of the negative takes people can have about SA.

Absolutely. That said, the bigger effect is actually from geysers since almost every house has one whereas batteries are not as widely spread. As the power comes back on the geyser will suddenly draw substantially since the temp will have fallen during the scheduled cut.

Accordingly there have been big govt. subsidies for geyser timers to put on your DB and solar geysers to try reduce this effect. Big information campaigns about not running the geyser all the time etc.

The consequences can be substantial, the city electricity depts. have to continually deal with substations and local transformers blowing up (literally, in an explosion, I've seen the aftermath!) because of the demand surges. Some areas are exempted from the scheduled cuts in my city to preserve older infrastructure.

Additionally, insurance companies report big spikes in claims from devices being damaged due to the unstable power as it reconnects. In my house everything is behind varying levels of surge protection, and interestingly I actually have SA made surge plugs that don't pass power through for the first 5 minutes after powering back on. This way my fridge compressor won't be damaged by unstable power (e.g. sudden substantially lower voltage, or a surge) as the scheduled cut ends.