If we put people in a jet with poor training and they crash, that's the pilot's fault, yet if people crash LLMs, that's the LLMs fault. If a study showed 95% of people crashed jets without training, I wouldn't take that as a sign jets are a flawed idea.
As it is, I have no problem with your naysaying, I'm getting results, your disbelief doesn't change that, in fact I find it more amusing than anything.
> If we put people in a jet with poor training and they crash, that's the pilot's fault
Yet if you make a plane and say that you don't need training or a license to operate it and you crash then yes, it is the plane's fault.
> I'm getting results, your disbelief doesn't change that
Many of these studies show participants self rate as being more productive and getting things done more quickly. In fact, self reporting is well known to be an unreliable metric. People frequently hallucinate. People self report seeing ghosts, aliens, demons, Big Foot, past lives, and all kinds of things that don't exist. Most of these people aren't lying either, they believe the things they report. Most people (probably everybody) have experienced the Mandela Effect in some form or another. Hell, we even know eye witness testimony can be unreliable and even manipulated/influenced.
I've seen plenty around me who claim to be faster with the help of AI. Some are! But most seem to be faster at producing lines of code, not faster at completing the goal. I see a lot more slop and frequently that slop just results in work being outsourced to others. Which, to be fair, does mean they're "faster". But their speed is not on the intended metric.
Maybe I'm the one hallucinating. But maybe you are too. All I know is that when I use AI tools I feel faster but I've also found a get a lot less done.
I don't need to vibe my productivity improvement, I can see it in the 18 projects and 3 scientific papers I've gotten close to complete in the last 2.5 weeks.
Great! If you got more to go off of than vibes then that's a great sign. Tons of people measure their performance in vibes. Frankly, because performance is a really difficult thing to measure.
But we're all just talking to "some random dude on the internet" and that context isn't shared. I'm certain you see both people where AI is helping as well as people where it isn't. Maybe in different proportions than others. But if you're upset that I don't know you, well... that's a bit hard to do in forums like this.
I'm not upset that you don't know me, and I'm fine with people saying AI isn't for them. I even acknowledge that cursor jockeying is only marginally better than hand coding in many cases.
That's a very different situation from having an intensive conversation with an AI to generate a formalized CUE spec with correctness guards, E2E testing specifications, etc, then decomposing that spec into lanes and dispatching a swarm of agents to build it, review work, implement e2e tests/QA, etc. They're both AI, but one is vibe coding and one is autonomous engineering.
Ah, there it is. The excuses, it's scrum all over again.
Mystical practitioners discount the studies done in the open as not fair or not being done right, or the people participating not believing in it hard enough.
> As it is, I have no problem with your naysaying, I'm getting results, your disbelief doesn't change that
Studies and evidence mean nothing to cults and religious believers, so yeah, I am happy that you feel and believe like you have your personal connection to the higher being that is the LLM. Keep the faith!
I don't care about the failures of others. I am succeeding. A study in 1920 would have proved that a man couldn't run a 4 minute mile, imagine if people had stopped trying.
As it is, I have no problem with your naysaying, I'm getting results, your disbelief doesn't change that, in fact I find it more amusing than anything.