estreeper
Joined 14 years ago
Karma
493
Submissions
92
Member since
Sep 14
Recent submissions
Comment · 1 year ago
It wouldn’t be HN if your joke wasn’t met with pedantry, so I’ll mention the heat and pressure at the surface means the atmosphere is a supercritical fluid of 96.5% carbon dioxide and 3.5% nitrogen.
Buyers should have all the facts
Comment · 1 year ago
Very exciting - I'm a long-time vim user but most of my coworkers use VSCode, and I've been wanting to try out in-editor completion tools like this.
After using it for a couple hours (on Elixir code) with Qwen2.5-Coder-3B and no attempts to customize it, this checks a lot of boxes for me:
- I pretty much want fancy autocomplete: filling in obvious things and saving my fingers the work, and these suggestions are pretty good
- the default keybindings work for me, I like that I can keep current line or multi-line suggestions
- no concerns around sending code off to a third-party
- works offline when I'm traveling
- it's fast!
Comment · 1 year ago
This is a tough question to answer, because it depends a lot on what you want to do! One way to approach it may be to look at what models you want to run and check the amount of VRAM they need. A back-of-the-napkin method taken from here[0] is:
VRAM (GB) = 1.2 * number of parameters (in billions) * bits per parameter / 8
Because quantization is often nearly free in terms of output quality, you should usually look for quantized versions. For example, Llama 3.2 uses 16-bit parameters but has a 4-bit quantized version, and looking at the formula above you can see that will allow you to run a 4x larger model.
Having enough VRAM will allow you to run a model, but performance is dependent on a lot of other factors. For a much deeper dive into how all of this works along with price/dollar recommendations (though from last year!), Tim Dettmers wrote this excellent article: https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...
Worth mentioning for the benefit of those who don't want to buy a GPU: there are also models which have been converted to run on CPU.
[0] https://blog.runpod.io/understanding-vram-and-how-much-your-...
Comment · 1 year ago
Total healthcare spending per capita includes insurance premiums too though, which is $8,951 for single coverage and $25,572 for family coverage[0], and needs to be added to that ~$1,400 to get the total cost. Some amount of this may be paid by employers, but is still theoretically money that could go to you otherwise.
[0] https://www.kff.org/report-section/ehbs-2024-section-1-cost-...
Comment · 1 year ago
A nice tradeoff in many cases is to have a separate schema rather than a separate database, which allows preserving referential integrity and using the database’s RBAC to restrict access to the schemas. This also means things like cascading deletes can still work.
Comment · 1 year ago
> it’s been a net negative for taxpayers
This analysis[1] from the Cato Institute found the opposite: “immigrants pay more in taxes than they consume in benefits”.
[1] https://www.cato.org/blog/fiscal-impact-immigration-united-s...
Comment · 1 year ago
We've built many production apps using LiveView. It has some limitations inherent to its design, namely the need to have a semi-reliable WebSocket connection to be able to effectively use the app, but with this tradeoff come a number of advantages:
- code generation makes for an extremely productive experience that makes standing up an actually-useful application very fast
- Elixir is a great language, especially for the web, and using it to render the frontend feels like having the full power of the language plus the simplicity of HTML (with little/no writing JavaScript)
- it's extremely efficient since only tiny changes are sent over the WebSocket when data is updated on the server
- you're already using WebSockets, so adding any kind of real-time functionality is very easy (chat, notifications, game state)
We've hit some bugs and gotchas over the years leading up to this 1.0 release, but it has long felt like a stable, well-built library that keeps our codebases simple and maintainable, which lets you move fast.
Congratulations to Chris, Jose, and all the other wonderful contributors!
Comment · 2 years ago
In the United States, federal tax applies when the estate is valued over $13.6M for 2024[1], though as you mention spousal transfers and other methods can be used for tax avoidance as well.
1. https://www.irs.gov/businesses/small-businesses-self-employe...
Comment · 2 years ago
Not to mention various other wars and random fires, such as the Ōnin War 応仁の乱 in the 1400s, a civil war between many feudal lords, which destroyed much of Kyoto among other areas.
The world's oldest extant wooden structure is the Kondō (main hall) of the temple Hōryū-ji 法隆寺 in Ikaruga, in the Nara Prefecture of Japan. It was initially built in 607 but completely burned down due to lightning. It was rebuilt in 670, but again nearly burned down by accident in 1949 [1].
It's interesting to contemplate how across these timescales war, disasters, and accidents make it so difficult for structures to survive.
Comment · 2 years ago
Here’s a short video of this armor in action: https://youtu.be/rm2ZR25xU8M?si=6HdtRO8cFxB5HO8l
Comment · 2 years ago
I'm curious how people are handling multi-lingual embeddings.
I've found LASER[1] which originally had the idea to embed all languages in the same vector space, though it's a bit harder to use than models available through SentenceTransformers. LASER2 stuck with this approach, but LASER3 switched to language-specific models. However, I haven't found benchmarks for these models, and they were released about 2 years ago.
Another alternative would be to translate everything before embedding, which would introduce some amount of error, though maybe it wouldn't be significant.
Comment · 2 years ago
Just to add to this, a great resource is the Massive Text Embedding Benchmark (MTEB) leaderboard which you can use to find good models to evaluate, and there are many open models that outperform i.e. OpenAI's text-embedding-ada-002, currently ranked #46 for retrieval, which you can use with SentenceTransformers.
I love working with AI, web technologies, and anything involving the intersection of software and art.
Feel free to contact me for any reason!
[email protected]