Coding succeeds because compilers provide clear feedback loops
We see the biggest success in coding because there’s a clear feedback loop. When I ask an AI to write code, it can check if the code compiles. If it doesn’t work, ChatGPT critiques that and the next step is to rewrite the code including the critique. This iterative loop continues till it actually works. The combination of knowing what was put in previously through memory, plus the ability to talk to a compiler, plus the iteration workflow creates a loop to generate good code. It’s more difficult when the task isn’t very clear or doesn’t have such obvious success criteria.
— Connecting LLMs to the world: The possibilities of the feedback loop · The Edge