{"by":"aslang","descendants":3,"id":49609821,"kids":[49641240,49624769,49609866,49611453,49609837,49609835],"score":5,"text":"Full technical essay with benchmarks & AST breakdowns:\nhttps://aslang.dev/blog/why-llms-struggle-with-python-and-rust

Over the past two years, watching coding agents generate code, we kept noticing an identical failure pattern: models spend 32% to 41% of their inference compute trapped in syntax repair loops.

When we investigated the information theory behind this, we realized the problem is not model scale—it is the computational geometry of transformer attention heads when confronted with human-centric grammars:\n1. Python's off-side rule: Lexing requires an internal LIFO indentation stack. Closing 3 blocks emits 0 characters. A single whitespace token split silently re-parents AST subtrees.\n2. Rust's borrow checker: Validity depends on non-local constraint solving across lifetimes and CFGs. Autoregressive generation is strictly forward causal (O(1) feedforward); it cannot backpropagate lifetime conflicts backward during generation.

We built AgentScript (ASL): an open-source, statically typed language using single-pass S-expressions that compiles directly to native Rust, Go, TypeScript, and WebAssembly (wasm32-wasip1).

Key properties enforced by construction:\n* Balanced parentheses by grammar: Left-to-right attention heads always know parent scope.\n* Closed vocabulary (prelude.json): 100% of builtins are type-checked and evaluated; no unmodeled foreign calls.\n* Sub-millisecond Wasm sandboxing: In-memory WASI preview1 execution in 0.038ms without Docker/microVM spin-up.\n* Syntax repair collapse: Models spend 46.5% of generated tokens fixing syntax in Rust (our hard baseline) and 34.2% in Python. In AgentScript, repair iterations drop by 98.3% vs Rust baseline (from 4.8 cycles to 0.08), cutting syntax repair waste to just 1.2%.

Our Mission: The Best Harness for Local Development with Small Models\nWhile frontier models on cloud clusters partially brute-force messy human grammars, our mission is to build the most effective autonomous harness for local development with small models (SLMs: 3B to 31B like Qwen, Gemma, Llama) running directly on developer machines.

On Apple Silicon or laptops, memory and attention are precious. A single-pass, parenthesis-balanced language combined with resident AST batch RPC eliminates the syntax churn and context rot that derail small models.

Pre-Release Alpha & Active Development:\nAgentScript is in early pre-release alpha—we do not have a tagged v0.1 release yet and are actively migrating to a 100% self-hosted compiler & WASI runtime. But even at this stage, empirical results inside agent loops are remarkably compelling.

Try It Locally & In Your Agent Skills:\nWe do not offer an in-browser playground—test the real thing directly in realistic agent workflows:\n1. CLI toolchain: curl -fsSL https://aslang.dev/install.sh | bash (or clone GenSEAM/asl & cargo build --release)\n2. Equip agent skills (Claude Code, Cursor, Antigravity) with AST verification and batch RPC:\n asl rpc '(:batch (:out "src/main.asl") (:sym "my_func"))'

Terminal-Bench 4.0 Baseline (Macro Results, Not Cherry-Picked):\nWe packaged our baseline submission on Terminal-Bench 4.0 (tested on Gemma 4 31B under strict airgap boundaries):\n* Macro Pass Rate: 13.5% across all 89 evaluated tasks (12 verified passes / 89 total tasks).\n* Baseline Comparison: Common harnesses (Claude Code, Codex, CLI loops) score 0.0% on this suite when paired with open-weights models due to subshell state loss, quoting drift, and context blowup. Pure ASL achieves 13.5% on Gemma 31B in airgap.\n* Token Economy: 77.3% token savings vs standard agent CLI baselines.

Transcripts & submission tarball: https://github.com/GenSEAM/harness\nCore compiler & runtime repo: https://github.com/GenSEAM/asl

We would love critical feedback from compiler engineers, language designers, and systems builders on the grammar design and agent steering architecture!","time":1788872658,"title":"Why human syntax breaks LLMs (and how to fix agentic coding)","type":"story"}

aslang

Recent submissions

Why human syntax breaks LLMs (and how to fix agentic coding)