thadk
Joined 17 years ago
Joined 17 years ago
I put together this Hammerspoon spoon with a few brew libraries and some inline Swift code.
You paste twice quickly to trigger it, and you can iterate formats with a keystroke. https://gist.github.com/thadk/8b178aa93dafcab92ca579825f8191...
Time to first token (TTFT) on 5,687 tokens, like pasting a short code block into the prompt, takes 36 seconds vs 4.7 seconds. It also breaks down the seconds for each step like KV and prefilling.
Gemma4 31B TTFT on the M5 Max 128gb with same setup is showing as 19 seconds.
An ineffable game happens that one's retreat diminishes.
https://www.econtalk.org/venkatesh-rao-on-waldenponding/ https://studio.ribbonfarm.com/p/against-waldenponding-ii
(pardon for reposting just now from off-front-page thread on https://declaude.org/watermarking/, just thought of question)
Zvi's retelling handles this better. Zvi speculates that the secret message board familiarity was carried because it had been trained into the May-and-subsequent models: https://thezvi.substack.com/p/openai-trained-its-models-for-...
https://observablehq.com/@fil/airocean-projection
The source data is down for my vector tile remix of it but here is a screenshot: https://static.observableusercontent.com/thumbnail/0fac8a928... and the code: https://observablehq.com/@thadk/reprojecting-vector-tiles
I did it as a little MapTime project in 2019 or so.
Until now, I had not thought to try to lock down the settings that lead to accidental reflows. It sounds less difficult in KOReader than I expected. I may try to stabilize it for my next ebook I can get into KOReader.
It seems to me that LLMs and particularly chatbots have already allowed for bigger scale collaboration within the LLM companies versus what was possible within the prior cohort of big platform companies.
Has the result just been taller towers, or actually a change of what is possible?