el_isma

Joined 10 years ago

Karma

Submissions

Member since

Mar 30

Recent submissions

Claude code's system prompt is filled with irrelevant stuff about how CC works, so that the agent can help the user set it up. And there's no way to disable all the extra stuff, AFAIK.

There's https://github.com/skrabe/lobotomized-claude-code , which strips many of those, but I'm not sure if it is "legal" to use.

Comment · 4 months ago

I always just play peaceful in factorio. No attacks to worry, just build.

Comment · 4 months ago

Don't, unless you're ready to "waste" 200hrs. They call it cracktorio for a reason. And the devs have a "no sales" policy.

Comment · 6 months ago

How is this different from the speculative decoding that we had before?

You could pair a big and small model like qwen 32b with qwen 4b and had that same dynamic of the small model generating tokens and the big one "certifiying" them.

The blog says something about re-using the big model's data?

Comment · 7 months ago

* "small" as measured by estimated lifetime duration

Comment · 8 months ago

How does it compare to https://github.com/vercel-labs/agent-browser ? Which also provides token efficient way to interact with the browser.

Comment · 1 year ago

Can you share how you beat it?

Comment · 1 year ago

0.6/1$ per M tokens in groq/cerebras vs 0.3$ per M tokens in deepinfra (for llama 3.3 70b)

But note the free tiers for groq and cerebras are very generous.

Comment · 2 years ago

Don't know if this fits, but given your background you might find it interesting. I work at a startup which works with structured video, video which has a certain structure and so allows for reuse of segments. Our challenge is how to show the user this structure, when videos can quickly grow in complexity and end up having multiple thousands of possible variations. Contact me at ismael at lont.ai if you're interested.

Comment · 2 years ago

In ECS I had to recreate the cluster from scratch because some of the changes I wanted to do, CDK/CF wouldn't do.

My approach on Azure has been to rely as little as possible in their Infra-as-code, and do everything I can to setup the cluster using K8s native stuff. So, add-ons, RBAC, metrics, all I'd try to handle with Helm. That way if I ever need to change K8s provider, it "should" be easy.

Comment · 2 years ago

I started with ECS (because I wanted to avoid the complexity of K8s) and regret it. I feel I wasted a lot of time there.

In ECS, service updates would take 15 min or more (vs basically instant in K8s).

ECS has weird limits on how many containers you can run on one instance [0]. And in the network mode where you can run more containers on a host, then the DNS is a mess (you need to lookup SRV records to find out the port).

Using ECS with CDK/Cloudformation is very painful. They don't support everything (specially regarding Blue/Green deployments), and sometimes they can't apply changes you do to a service. When initially setting up everything, I had to recreate the whole cluster from scratch several times. You can argue that's because I didn't know enough, but if that ever happened to me on prod I'd be screwed.

I haven't used EKS (I switched to Azure), so maybe EKS has their own complex painful points. I'm trying to keep my K8s as vanilla as possible to avoid the cloud lock-in.

[0] https://docs.aws.amazon.com/AmazonECS/latest/bestpracticesgu...

Comment · 3 years ago

Indeed. You can build a system to mitigate most other things, but infinite procastination and the associated guilt is awful.

I live by my calendar. I try to write everything I have to do down. I put my things always in the same place. But procastination...

Meds do help a bit.

Comment · 3 years ago

How do you break down the segments/sections? Is it just fixed time? What happens if there are more than one topic discussed in the segment?

Are you using both chatgpt and mistral? Do you use them for different tasks?

Comment · 3 years ago

At least for their other offerings, you can't set the specific language:

https://help.elevenlabs.io/hc/en-us/articles/14888868300177-...

https://help.elevenlabs.io/hc/en-us/articles/14888917355409-...

Comment · 3 years ago

I've found their system tries to guess the language of the text, but there are many languages that use the same words, and so it will speak in the wrong language (or accent, even). I hope they make a solution for this, otherwise I don't think it will be suitable for production use cases.