sunpazed

Joined 14 years ago

Karma
431
Submissions
114
Member since
Sep 15
http://twitter.com/sunpazed
View on Hacker News

Recent submissions

Comment · 4 months ago
Comment · 1 year ago
This is really impressive. At these speeds, it’s possible to run agents with multi-tool turns within seconds. Consider it a feature rich, “non-deterministic API” for your platform or business.
Comment · 1 year ago
Thanks so much for delivering on this model. It’s great as a draft model for speculative decoding. Keep up the great work!!
Comment · 1 year ago
Don’t have enough ram for this model, however the smaller 20B model runs nice and fast on my MacBook and is reasonably good for my use-cases. Pity that function calling is still broken with llama.cpp
Comment · 1 year ago
In my testing, tokens per sec is half the speed of the GPU, however the power usage is 10x less — 2 watts ANE vs 20 watts GPU on my M4 Pro.
Comment · 1 year ago
The key benefit is significant lower power usage. Benchmarked llama3.2-1B on my machines; M1 Max (47t/s, ~1.8 watts), M4 Pro (62t/s, ~2.8 watts). The GPU is twice as fast (even faster on the Max), but draws much more power (~20 watts) vs the ANE.

Also the ANE models are limited to 512 tokens of context, so unlikely yet to use these in production.

Comment · 1 year ago
Love this! The C64 introduced me to the world of computers as a kid. I still have that almost 40 year old machine in my collection, but I’m weary of failure every time I turn it on. This is somewhat better than the MiSTer as I can use physical peripherals with it. Great work!
Comment · 1 year ago
Let’s remind ourselves that MCP was announced to the world in November 2024, only 4 short months ago. The RFC is actively being worked on and evolving.
Comment · 1 year ago
Comment · 1 year ago
Funny to see you here. I’m from operata.io (also a Melbourne based startup) and would see your website (operatr.io) when I would mis-spell mine!
Comment · 1 year ago
Comment · 1 year ago
Great stuff! I used both LiteLLM and Langfuse for a recent project at work — both tools were instrumental in development and deployment. Looking forward to seeing how this collaboration develops.
Comment · 1 year ago
Even though I have a reasonable intuition and understanding of how a LLM works, I am still awe-struck each and every time I use one. The fact that I have a junior developer at my convenience is a huge efficiency gain. I’ve been able to automate the rudimentary elements and focus my time on the stuff that counts.
Comment · 2 years ago
Operata | Data Engineer, Business Dev + others | REMOTE (AU & US) | Full-time

Operata is building the world's first observability platform for Cloud Contact Centers. We're a VC-backed, small 13 person team — and have grown significantly in the last year. Operata is an AWS Select Technology Partner, and our customers include leading insurers, telcos, banks and managed service providers. We have serious traction and are scaling up!

https://operata.com/careers

We're hiring a few roles:

Data Engineer — Looking for expertise in ETL/ELT processes, data lake-house platforms, data modelling and data pipeline development. Proficiency with real-time data processing platforms such as Apache Flink, Spark, Airflow, or DataBricks is a plus.

Data Analyst — Looking to improve our data culture, establish an analytics practice, and level-up the capability of our Observability product.

Director, Solutions Engineering + Director, Business Development — US (Remote), PT or CT Time Zones. Looking for experience in technical sales, solutions architecture, sales engineering or enterprise sales in cloud or communications related software products.

Check out the webpage, or DM me for more.

Comment · 2 years ago
This is an unfair and snide take on Woz. We are literally standing on the shoulders of giants — Woz happens to be one of them.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton