Hey, have enjoyed reading the article. Not sure I agree with the conclusion though. "But the LLM has no basis for choosing between topologies. ... The developer’s job is not just translating specs into code. Any competent developer can do that. A capable LLM can do that." I believe it can. We are just talking about different level of approximation -- nothing that can't be solved with enough context. And even this “higher-level context” can be inferred from modern training approaches — not by focusing on “what” or “why,” but by inferring how components relate and interact, regardless of purpose.
Hey, have enjoyed reading the article. Not sure I agree with the conclusion though. "But the LLM has no basis for choosing between topologies. ... The developer’s job is not just translating specs into code. Any competent developer can do that. A capable LLM can do that." I believe it can. We are just talking about different level of approximation -- nothing that can't be solved with enough context. And even this “higher-level context” can be inferred from modern training approaches — not by focusing on “what” or “why,” but by inferring how components relate and interact, regardless of purpose.