kmod
Joined 17 years ago
Karma
3,205
Submissions
341
Member since
Jul 24
Recent submissions
Comment · 9 days ago
I think that's a much lower bar than you are assuming. It's part of their playbook to tie very basic features and integrations with these more controversial measures -- I believe that "make calendar entries from flight confirmations" is on by default and is part of their "share my data with other services" toggle. "Declining to opt out" could also count to them as choosing to make the data available. etc.
Comment · 19 days ago
I've been dismissive of the SVG-of-pelicans benchmark, but last night ChatGPT (on the website, toggle set to GPT-6 High) generated some SVGs and included them in our chat. I'm not sure that this feature was that valuable in this case, but it seems that textually generating SVGs is now a product feature at least for ChatGPT. The SVGs had some clear issues and I found myself wishing that it had done a better job: the nose of the rocket is overlapping with the rocket body, and in the second image I think there's only supposed to be one orange line but it tried to add styling or something that went wrong.
<https://tools.simonwillison.net/svg-render#%3Csvg%20font-fam...> <https://tools.simonwillison.net/svg-render#%3Csvg%20font-fam...>
- I was having trouble embedding the SVGs as links, and ChatGPT recommended Simon Willison's SVG Renderer as a workaround.
Just my 2 cents on the pelicans benchmark: I think it might help if you were a bit more explicit about not taking this one benchmark too seriously. I know you say that at times, but at other times (such as the comment I'm replying to) you elide it which can read as a seriousness about the benchmark.
Comment · 3 months ago
This $23B number that gets thrown around is not the increase to the public. The wording in the referenced report is
> Based on actual auction clearing prices and quantities and uplift MW, inclusion of existing and forecast data center load growth resulted in a combined total increase in capacity market revenue for the 2025/2026 BRA, the 2026/2027 BRA, and the 2027/2028 BRA of $23,100,955,341.
This is the increase in revenue to PJM from adding datacenter customers, and includes both the amount that datacenters paid as well as the amount that other customers paid due to higher prices from datacenters. So Fortune calling it an increase to "the public" means that they didn't read the report they are using as their source and are probably just repeating what they thought someone else meant.
Bloomberg in the past worded it as "data centers will add at least $23 billion to customer bills" in April and "added a minimum of $23 billion to customer bills" in February. Which while technically correct (datacenters are customers) seems meant to be misleading. And now that's the number that's getting thrown around as the increase to "the public".
The part I don't get is that the journalists could just give the actual number for the quantity that they are referring to (the amount that non-datacenters paid due to higher rates due to datacenter loads): when I calculated it a few months ago I think it was something like $16 billion rather than $23 billion. I feel like the story would have the same impact if the headline number was $16B as $23B, but $16B has the benefit of not being a misrepresentation of the situation.
---
Also I would definitely recommend checking out the PJM BRA report. It's a bit dense but not too hard to follow, and my personal takeaway was that the PJM market is just very dysfunctional and they are blaming the datacenters instead. I thought SemiAnalysis had a good analysis of it: https://newsletter.semianalysis.com/p/are-ai-datacenters-inc...
Comment · 7 months ago
Fwiw this got changed about a week ago, where they changed the logic to match the documentation rather than default to sending your prompts to their servers. This is why so many people have noticed this happening but if you ask an AI about it right now it will say this is not true.
Personally I think it's necessary to run opencode itself inside a sandbox, and if you do that you can see all of the rejected network calls it's trying to make even in local mode. I use srt and it was pretty straightforward to set up
Comment · 8 months ago
I think it's interesting that they dropped the date from the API model name, and it's just called "claude-opus-4-6", vs the previous was "claude-opus-4-5-20251101". This isn't an alias like "claude-opus-4-5" was, it's the actual model name. I think this means they're comfortable with bumping the version number if they want to release a revision.
Comment · 1 year ago
They are definitely capable of writing such statements, which you can see in their enterprise products. In my Google Workspace gemini app it says pretty prominently and clearly:
Your [ORGNAME] chats aren’t used to improve our models
So they definitely understand that people want to hear that their data isn't being used for training, and they know how to say it clearly and reassuringly. Which makes the omission of that in their consumer products more telling in my view.
Comment · 1 year ago
https://azallianceforgolf.org/wp-content/uploads/2023/01/C-S...
page 21, says Arizona 2015 golf course irrigation was 120 million gallons per day, citing the US Geological Survey.
https://dgtlinfra.com/data-center-water-usage/
says Google's datacenter water consumption in 2023 was 5.2 billion gallons, or ~14 million gallons a day. Microsoft was ~4.7, Facebook was 2.6, AWS didn't seem to disclose, Apple was 2.3. These numbers seem pulled from what the companies published.
The total for these companies was ~30 million gallons a day. Apply your best guesses as to what fraction of datacenter usage they are, what fraction of datacenter usage is AI, and what 2025 usage looks like compared to 2023. My guess is it's unlikely to come out to more than 120 million.
I didn't vet this that carefully so take the numbers with a grain of salt, but the rough comparison does seem to hold that Arizona golf courses are larger users of water.
Agricultural numbers are much higher, the California almond industry uses ~4000 million gallons of water a day.
Comment · 1 year ago
I was also surprised when someone asked me about AI's water consumption because I had never heard of it being an issue. But a cursory search shows that datacenters use quite a bit more water than I realized, on the order of 1 liter of water per kWh of electricity. I see a lot of talk about how the hyperscalers are doing better than this and are trying to get to net-positive, but everything I saw was about quantifying and optimizing this number rather than debunking it as some sort of myth.
I find "1 liter per kWh" to be a bit hard to visualize, but when they talk about building a gigawatt datacenter, that's 278L/s. A typical showerhead is 0.16L/s. The Californian almond industry apparently uses roughly 200kL/s averaged over the entire year -- 278L/s is enough for about 4 square miles of almond orchards.
So it seems like a real thing but maybe not that drastic, especially since I think the hyperscaler numbers are better than this.
Comment · 1 year ago
I've found a method that gives me a lot more clarity about a company's privacy policy:
1. Go to their enterprise site
2. See what privacy guarantees they advertise above the consumer product
3. Conclusion: those are things that you do not get in the consumer product
For Code Assist, here's their enterprise-oriented page vs their consumer-oriented page:
https://cloud.google.com/gemini/docs/codeassist/security-pri...
https://developers.google.com/gemini-code-assist/resources/p...
It seems like these are both incomplete and one would need to read their overall pages, which would be something more like
https://support.google.com/a/answer/15706919?hl=en
https://support.google.com/gemini/answer/13594961?hl=en#revi...
Comment · 1 year ago
I agree in general, but I think some important context here is that the author of this post was previously on the OpenAI board (the board that fired Sam Altman).
Comment · 1 year ago
The worst part to me is the privacy nightmare with AI Studio. It's essentially impossible to tell whether any particular API call will end up being included in their training data since this depends on properties that are stored elsewhere and are not available to the developer -- even a simple property such as "does this account have billing enabled" is oddly difficult to evaluate, and I was told by their support that because I at one point had any free credits on my account that it was a trial account and not a billed account even though I had a credit card attached and was being charged. I don't know if this is true and there is no way for me to find out.
At some point they updated their privacy policy in regards to this, but instead of saying that this will cause them to train on your data, now the privacy policy says both that they will train on this data and that they will not train on this data, with no indication of which statement takes precedence over the other.