Szpadel

if you want to save some $ you can start with abliteration and after few turns switch to normal glm5.3 for example from z.ai subscription or other source. I didn't test it yet with deepseek, but I'm assuming it will will work the same.

those models will follow your request when they already agreed to do this

deepseek tends to quickly assume this is benchmark and even when have web access thinks things like "simulated internet" etc (but waste tokens on thinking if there could be way to cheat)

does it increase or decrease? :)

I usually copy paste snippet or function name that is affected and comment it. similar like you would sit next to coworker and tried to say where he/she messed up. agent is able to get location correctly

I know this is change of context, but I have full screen terminal toggled with keyboard shortcut and with middle mouse paste (Linux) I do not have to move cursor anywhere

the compaction does not compact whole context, but keeps last ~20k tokens as is, I believe this helps a lot to model to not get confused what it is doing right now.

it also have soft/soft compaction limit, it tries to compact on turn boundary when possible. with combining with above this can get you about 35% more context (at least it looks like this with the sol)

codex when shell command is executed, will pull output with hard cap at max 30s, so for running compilation it will burn tokens without any benefit.

I have some tasks where agent will have to run some suite that can take over an hour, and codex burns about $20/h just waiting and reasoning every 30s "yep, that's still running". And what is going to happen after compaction, when whole context was just waiting? it will loose the plot and when I'm back it just does completely different thing that I asked it to do.

codex also have a bug, that opening refuses to resolve that adds your last steer after compaction, so imagine that you asked it to cleanup some tmp files or refactor/simplify something. it will do that again and again after each compaction, best case it just burns tokens and figures out, this is already done, or worse do it again and mess up everything and forget about it's task

in my experience pi does much better than codex for compaction and token use. And this is the main reason I switched to it.

migrating to the same compaction and exact tools as codex uses will make it at the same level as codex so what benefit will it have over codex? sure you can customize tui to your liking and add something on top, but the efficiency gains will be gone

there seems to be very big misunderstanding about what the "ultra" is, so let me explain it basing on the codex source code:

it's similar to Claude code ultracode.

there is no ultra effort level implemented on the backend. it's just alias in the codex to max effort setting and single line addition to prompt to use subagents proactively. that's all

as far as we know pro models work differently. for once those are backend implementations and they probably run multiple parallel reasonings for any chunk and use some judgement model to pick best version as persistent one. but that's what I believe is most popular guess, because this is openai secret sauce.

there is still no way to use pro models from codex, or at leat so far there is no trace of it anywhere.

big misconception

open source != open weights

open weights model is like... Winamp for example. it's free, you can download it and use it however you like, you could also do some binary patching or dll injections to alter it functionality but it's not enough to develop next version.

the same is with ai models, weights are the binary final artifacts. for development and improvements you need to have training data, pipelines, RL harnesses, etc.

also of you believe Chinese companies will be releasing weights indefinitely, you are not understanding motivations.

Chinese companies spend significant amounts of money to train a model so why they are releasing it for free? they basically provide researchers starting point for developing tooling and optimizations for serving the model in return. and also get some PR. They also do not have to pay for inference of those models that much, as they probably serve them with loss anyways to gain market. they are gov sponsored so money are not issue there, so they try to speedrun their way to what US companies have. And guess what happens when they reach it. they will stop releasing weights and increase pricing or will use them for gov purposes.

now, that should teach him to sell those on black marked instead

I'm mostly joking here, but Microsoft is one of few companies that handle cyber security in a way that really incentive people to not report them.

it's either by downplaying impact and not paying or paying very little or doing other researcher hostile activities.

especially that someone here mentioned some time ago that black market pays about 3x for the same class of vulnerability, so you need fairly high moral standards to go direct way

> but as far as I can tell those credit costs are an exact match for the API token costs listed for those models.

it is only true for USD. for example if you pay in euro, this is actually more expensive. kind of makes no sense, because it translates to $1 = €1

I'm assuming that right now all valves as computer controlled so why we cannot have best of both worlds? cannot we dynamically switch between Otto and Atkinson cycles by just changing valve profiles?

computer could use Otto cycle in case more power is needed in rare situations

huge red flag

> Non-technical teams are now shipping production code

if you vibe code financial systems this cannot mean anything good for your business

> Zero Electron imports remaining in the codebase

and you know that AI wrote all of it with minimal human supervision.

side note: last few days I noticed that vscode stopped leaking memory all over the place. when left idle it was taking all the ram I had + 20gb of swap space

and recently I noticed that I have half of the ram free.

I use insiders build btw, so stable might still not have those improvements