saejox

i believe a harness is a personalized thing. everyone should develop their own. doesn't take long to have a working prototype, after that you can extend it as you use it.

it is very hard to run 150k token context with these kind of setups. even if you do, all of us are used to running multiple agents at once.

i hope ram prices will come down a little.

turn this in to a puzzle game. i am sure there are some enjoying ikea assembly.

Consistently buggy you mean. 1 in 10 tasks get stuck in reasoning loops or error out.

No human knows the answer to that question or to any any other technical question. that will be the world we live in

i asked copilot it says runtime interception and translation

Actual question is this:

As my weekly/hourly quota is nearing its end, does Anthropic start to serve me a worse model?

Am i personally being throttled? testing against API is meaningless.

i can buy a house with that amount of money. it used to be car money.

This is a project i wanted to implement for a long time. It regularly benchmarks cloud hosted models with private benchmarks. Not just openai & anthropic, popular openrouter models too.

Tests their intelligence, not their diligence.

Sadly i cant think of a way to monetize the service. Also if it ever gets famous enough labs would try to game the system, it would be cat&mouse game that i am not willing to waste time on without any monetary gain.

Not even close to astra. Astra is something else. It is expensive, but uses way fewer tokens do my tasks.

xAI missed its chance, Ball is on Anthropic's court.

Work days on case study only to be hacked and get even poorer.

To develop a smart ai system for my 2d roguelike platformer? game has way too many moving system for classic state-machine ai + i cant spare the time to develop it. its low latency entices me.

Needs to support tcp and udp

it is a feature called eventual consistency.

so nothing will be %100 correct, and we will always live in the past.

like downloading exe files from the web. but we should invent something to catch bad actors putting bad stuff in them