Moto7451

This is mostly a memory bandwidth issue. Qwen 3.8 27b and the related Bonsai 2 27B run on my M5 Max laptop with 36GB of ram. It’s a little slow due to my specific model having lower memory bandwidth than higher end models with more ram and cores. MoE models perform better here and expert streaming engines can allow larger than memory models to run.

From experience, if you work somewhere with very disconnected higher ups a sales person shows what your token usage is vs spend on the monthly subs for whatever set of users you have and then show an API price with a sample bill for even “more users” at that same number of tokens that is 30% lower. The crux of course being that your existing user base is not going to use fewer toke a just because you signed more people up and have a discount for the status quo.

Then when you consolidate all users to a single provider you find out you have a 2x to 3x larger bill because you… logically have more users at the same average token spend than the quote.

At my previous job, all while managing a full team, I did a lot of porting of legacy apps to modern standards to maintain various obligations. It was AI gen work in between meetings and paperwork. It was seen as such a success that I was asked to move to an IC role to focus on it within the “Elite new products team” that was supposed to be all AI and the latest tech. I showed up to find that they were pushing out low quality manually written code in 12 hour days six days per week to appear like LLMs were in use to save face because they lacked a token budget or the skills to properly manage one under the APIs. They had dismissed someone who had spent multiple thousands per month on Agent swarms. It was the perfect situation to make their 3x budget issue a 10-30x budget spend issue.

For many many reasons I left that job and got a new one but that was the cherry on top.

Let’s separate out what the companies actually want from the words they’re using for a moment. The top commercial companies are roughly stating:

1. Our AIs are so advanced they’re busting out of our networks and hacking people. We can’t seem to stop them.

2. There are real dangers to just how advanced our AIs are advancing.

3. Someone needs to slow us down

If these were true statements then they’d likely want to shut down themselves for the sake of the planet they live on. If there was a real problem as they have stated then shutting down is the solve (and to be clear, I’m not saying there aren’t problems with the AI industry. I just think they’re BSing us).

In reality this is marketing nonsense (better get in before the ban!) and “our” AI is never open weight/Chinese AI models which they have a different lobbying arm against. If the top four companies got a loosely regulated monopoly through regulatory capture, they’d be giddy.

I’m in the US but I’m basically charging the same way. 16A 240v. I’ve accidentally stepped it down to 13A and didn’t really notice. If you sleep, and can plug your car in while you do so, you can charge.

I think you’re experiencing paging to main memory rather than anything ReBAR related. ReBAR itself reduces memory copy operations. It’s of course possible you’re experiencing some sort of BIOS bug.

Resizable Base Address Register. In short, rather than the 256MB of mapped memory available to the CPU for any PCI device, ReBAR capable devices can map larger memory to the CPU’s addressable memory space. Without ReBAR or sufficient tricks (that Intel GPUs lack) you have to shuffle 256MB chunks around between GPU and CPU.

Mac OS 7 “Virtual Memory” was just the swap file. Fundamentally classic Mac OS had a flat memory layout with special hooks defined that did not allow for virtual memory as more commonly defined. Multiprocessing came in asymmetric and symmetric forms but really wasn’t terribly useful until 8.5/8.6 and later but by that time Mac OS X was about to show up which solved all these issues.

They can just add those people to the board. It’s not a set number and they don’t regularly add or remove people unless they think they can bring something to the table. Sometimes that is simply “holds a bajillion shares” but if they wanted a High Frequency Trading CEO on the board for insight into that, they could add both his kid and that CEO.

I have a fun entry to the exception to the topping rule. I have a diseased sycamore that was really struggling. The disease was primarily at the top of the tree. We were going to cut it down to prevent neighboring trees from being infected or the tree from falling. The cutting company had a “hold my beer” style suggestion that topping it would bring the tree back. Boy did it. It’s flourishing with new branches from the cut and beautiful coverage. The fungus hasn’t come back and I’m not worried about it dying and falling on my house. Everyone wins!

It's where the stuff ultimately goes since the creditors aren't interested in GPUs that no longer have much value. The context here is a crash, not just a basic bankruptcy. If it were that then absolutely it would be impounded by creditors (virtually or in reality) and then sold to the highest bidding data center.

I would in such a scenario expect the GPUs to be dumped to industrial breakers who would send them to China for refurbishment and repackaging before being sold again on Amazon, AliExpress, and Taobao as last gen gaming cards from weird brands and specs.

This is what happened after the great crypto GPU dumping.

That anecdotally matches my experience thinking about it.

After my initial hearing damage from someone clearing a rifle before everyone put on hearing protection it took a while for it to attenuate to background noise but flares beyond that volume. Things that certainly avoid flares is when I have a good sleeping setup where I avoid being crumpled or my neck kinked. I have good posture in general but sometimes weird working locations, off site meetings, hackathons, etc would lead to my tinnitus getting worse.

I chalked that up to being physically tired from travel and lacking sleep (both of which seems to also increase my tinnitus)but when reflecting back I don’t recall having much Tinnitus when my son was a newborn through a one year old and I basically slept walk that whole year.

I think on the count back the neck posture and likely the muscles in my neck and head lacking tension is what is keeping it from being worse.

Precisely. As someone who has done work in my home that has passed inspection, there’s a lot more to it than just taking a test. It’s the “how things are supposed to work” meets “how am I going to actually make this work” X factor that takes time and ultimately what people pay for.

Maybe not as fun but my sun room window unit is controlled by an off the shelf $20 thermostat designed for Air Conditioners. It’s the LUX Win 100 and is date/time programmable and features a compressor lockout so it doesn’t burn out your window unit by short cycling.

If you have a favorite smart thermostat you could also wire up a receptacle with a contactor between it and a cord and a 24v AC transformer wired to the line side. This would make your window unit controllable just like a central air conditioner.

This is why you pay the premium for epoxy grout. When we redid our house we used only epoxy grout and cleaning it as as simple as using a foaming tile spray.