neerajsi
Joined 9 years ago
Joined 9 years ago
I believe the new enabling technology for better codegen is tiered compilation, which has only been around for a couple years.
I hope we'll have some kind of good paradigm to do lora style learning or maybe an output subagent or something so we can better calibrate the output style in a fuzzy way. In context learning (instructions, memories) doesn't currently seem that effective.
Apparently a ctz solution is a bit longer, but doesn't cross from the floating to integer domain at all, so might be better in the overall algorithm. There are hidden implicit floating to int convert instructions.
This was a really cool little problem!
In a large multi-dll build like Windows or Office, the import/export information across modules is computed without doing codegen, so ltcg codegen can be done in parallel regardless of the module dependency graph.
I never worked deeply in the build systems for Linux based OSes or other unixes, but I gather that some symbol visibility choices make the build situation worse in Unix systems than Windows.
JIT is important to Apple platforms, and they seem to manage to make it work well enough even with the need for explicit invalidation.
The main problem I see with public economists is Goodharts law: When the predictive model becomes visible to the agents in the economy, there are stable strategies to counteract those models. So if economists want to remain good predictors of real outcomes, they have to collect massive amounts of data to feed the model but then remain mostly invisible afterward, so that the agents being analyzed don't change behavior too much.
In some sense, a known bad model that is used to set central policy may be good because the rest of the economic agents can work on a diversity of better models without correlating as much with each other and the known central model.