achille

Joined 18 years ago

Karma

1,244

Submissions

220

Member since

Oct 12

private, fast, efficient, sovreign models

[ my public key: https://keybase.io/achille; my proof: https://keybase.io/achille/sigs/Ssp4aG3wvUFOueb-AgaGbO-EojacIux_KZ2Jw3UkTKk ]

View on Hacker News

Recent submissions

Comment · 9 days ago

why not both? some perspective:

  0.5 Pwh/yr - worldwide data center energy
  4-5 PWh/yr - meat total farm to table
  166 PWh/yr - worldwide total energy production

the true bottleneck and cost we have is energy, carbon is a polite proxy if you can meaningfully cut down the energetic cost, that's very valuable either way

maybe tomorrow you'll want to spin up a GPU on the cloud to briefly run a model, pick a data center:

  DC #1: EU Efficient, but has ~100ms additional latency
  DC #2: TX Runs on jet engine turbines, neighbors complain of noise and air pollution

env impact is something worth considering regardless of industry

Comment · 1 month ago

> Ken Thompson: "...i really dont think it is useful. it is like replacing ipv6 with ipv50"

Comment · 2 months ago

file a ccpa data access request, they either have data to backup the usage (and must release it) or they don't have it (and should fix the issue)

Comment · 4 months ago

This is amazing! Most definitely headed in the right direction. The separation layer between front and back must be cut at the smallest possible 'slice'.

Lots of people here snarking would understand if they 'felt' the latency and additional overhead. Not enough thought has been put in carfully slicing the data for individual use cases.

I'd go even further, in his demo of 'generating load by moving the config often' -- I think that 'top' app should have 'jit-ed' more of the rendering on the client such that the only information traversing pi<>client is compresed delta's of the ps hose.

Comment · 5 months ago

latency on the gBus was at the time ~250msish but would regularly spike much more on certain sections. Each keystroke would have to roundtrip before appearing on the screen.

Using something like mosh would mitigate it, but there was no UDP tunnel available through beyoundcorp.

Cider and MDProxy were running rendering locally so the keystrokes were nearly instant.

Comment · 5 months ago

Yep, I made my own! (Xoogler 2017-2023) this is my noogler IDE story, one of my favorite, proudest hacks!

I developed a fork of the IntelliJ IDE on my second week at google out of raw frustration over latency. At the time I was commuting 2-3hrs/day SF<>MTV on the gBus.

Connectivity on the bus wasn't optimal, and there was high latency. Cider didn't have deep integration, and wasn't able to let me explore and understand the internal APIs effectively. I found it easier to enter a debug session within Intellij then 'vibe' and explore the internal apis via superComplicatedObject.ini<tab>.

Faced with an alien architecture + ADHD-unfriendly flow-crushing remote desktop latency -- and the lack of discoverability, I started hacking at it and without any knowledge of the system and architecture. Just tracing Intellij execution, subprocesses and network calls.

I was able to hack together a prototype in a few days that allowed me to run IntelliJ on my Mac, while the heavy bits ran on my corp desktop. The system would mount the remote filesystem over sshfs, would monitor and patch network connections and setup transparent shim binaries. Half of Intellij was running on the Mac (the front end) and the other half ran on Linux. Intellij didn't "know" that that it was running on a mac. This was initially implemented in a ~250 line shell script that patched everything.

It was called MDProxy[1] and ended getting adopted and supported during COVID as more development went remote. This became a source of many peer bonuses and spot bonuses. circa 2017* remote coding options at the time:

         typing   | code
         latency  | integration
         --------------------------
 cider   low      | meh 
 mdproxy low      | great
 ssh+vi  med      | meh
 rdp+iJ  crushing | great

[1] https://github.com/bazelbuild/intellij/blob/6b8f03c21172033a...

Comment · 6 months ago

What will happen to my "Grandfathered Plan" I signed up to test it, don't recall if I gave you my credit card

Comment · 6 months ago

url is 404'ing; what is the source for the skateboarding clip?

Comment · 6 months ago

what setup do you use for the bar at the bottom?

Comment · 7 months ago

due to library limitation, not language, they could use fancy-regex

Comment · 7 months ago

i registered for their demo and it seems to be unable to do any of the advertised features. nearly everything crashes; feels like a ux wireframe not yet wired it

Comment · 7 months ago

same here, would love to compare notes

Comment · 7 months ago

  - local data residency & sovereignty
  - latency
  - bandwidth 
  - regulatory climate
  - competition

uae is business friendly

all cloud providers have middle east presence

refineries generate terabytes of sensor data per hour

the population and people there produce and consume a lot of data

Comment · 8 months ago

Fun challenge: I asked Claude/Gemini to decode the audio by just uploading it as puzzle.wav. Claude is able to decode it:

https://claude.ai/share/4262fb6b-3ca1-407f-af0d-4d014686e65d