Joy & Curiosity #72

Interesting & joyful things from the previous week

Open on Substack · Markdown

Where does the disconnect come from? How can some programmers barely keep themselves from putting their hands to their head and scream ohmygodeverythingischanging and others just brush it off and say these models can’t write code?

At this point, I can only guess. Because by now I’d say that if they haven’t seen how the very fabric of software is going to change, that’s on them. It’s a one way door: people go through it, have their ohshit moment, then don’t turn back. So why haven’t more people stepped through it?

Is it because they simply haven’t used the models enough, not thrown enough problems of different sizes and type at them, in different environments? Do they still think that copy & pasting to and from ChatGPT is equivalent to using an agent that can utilize feedback loops (it’s not)?

Or have they not used the best models, the frontier models, and not spent enough money on them? Do they falsely think that the local modals they can run on their own hardware give them an idea of the trajectory we’re on?

Or, also an option, are they just bad at prompting? Do they really think that “fix it” is a good prompt? I’ve seen prompts like this and, yes, of course you’ll be unimpressed with what you get from that.

Or do they not know yet how big a difference it makes to tell the agent (not ChatGPT, not brains in a vat) how to run commands, in an AGENTS.md file or similar?

Are they judging the code the agent produced by how they, the human, would write it? Do they do that because they haven’t used LLMs to understand or parse code or change it later? Are they not pondering whether everything we’ve learned and read and taught in the last twenty, thirty years about “well, code isn’t just read by machines, it’s read by humans, which is why it needs to be Clean and Good and Formatted and needs to Communicate” — whether that isn’t a bit outdated now, because you can now ask a model to explain a given piece of code to you, in any language you want, with jokes and puns, as a poem or as a song?

Maybe they haven’t taken the hands off the wheel for long enough and see where the ride will end? Yes, vibe coding is the absolutele extreme, but try to take a simple file, have the agent write tests for it, have the agent run them, don’t look at the code, have the agent modify the code & run the tests, increase the scope, see where that leads you.

Or are they clinging onto the old world of determinism? They don’t like that the there’s a 3% chance that the agent doesn’t do the thing exactly like how I want it?

I don’t know. But if you haven’t tried all of the above, I highly recommend it. It’s time to see for yourself, with open eyes, what these models can and can’t do, and you won’t get a good look if you don’t push them hard enough in all directions.