kshitij_libra
Joined 12 years ago
Joined 12 years ago
What would your customers need to make them want to pay for it ?
So far no, but in the future with more specific and enterprise suitable tooling - likely
So how does one get published, enough to get into a good PhD program?
I wonder whether the problem is that its landed on an incorrect output sample (i.e re-sampling another code output would fix it ) .. vs … a feedback loop on the compiler output is what it really needs ..
Have you tried any of these agent based workflows that claim to be able to loop with some amount of reasoning ?
However as I was researching, there are a few interesting ideas in this space that might help these LLM's solve more complex problems in the future. Post here if interested: https://kshitij-banerjee.github.io/2024/04/30/can-llms-produ...
Main reason: a) to find the right code, I have to keep sampling it, and b) it doesn't seem to be able to solve larger / more complex problems that I actually find more need for.
I found some interesting research on combining planning-algorithms for complex problems, and some ideas on guiding the LLM's decoding process towards correctness by optimizing it via reward functions and reducing the search space. I've detailed and summarised the main points in the post above.
Questions:
1) Do you find code LLM's really useful? Please share some stories / examples where they help vs they didn't. I'm trying to form a better understanding they are just fancy, vs actually productive and useful to most
2) Any other research ideas being pursued in this field ? / what are you trying ?
Blog: kshitijbanerjee.com Email me at [email protected], I won’t bite.