Sent a pull request to Audacity fixing a crash bug I'd been running into frequently. The cause was an out-of-bounds memmove. Classic C++ areas.
Anyway I got a fucking copilot review on my PR which left two comments, both completely wrong, one of which suggesting I reintroduce the out of bounds memory access. I'm furious!
reshared this
Hailey
in reply to Hailey • • •Hailey
in reply to Hailey • • •Gwen, the Fops
in reply to Hailey • • •David Keck
in reply to Hailey • • •djsumdog
in reply to Hailey • • •woodland creature
in reply to djsumdog • • •Paolo Amoroso
in reply to Hailey • • •For example the Masterscope static analysis tool of Interlisp which still runs nicely on Medley Interlisp:
files.interlisp.org/medley/lib…
In the 1970s it could answer queries such as these (and didn't make stuff up):
. IS FOO BOUND BY ANY ON PATH TO ’PARSE
. WHICH ENTRIES OF ANY CALLING ’Y BIND ANY GLOBALVARS ON ’FOO
. WHO SETS ANY BOUND IN X OR CALLED BY Y
crab
in reply to Hailey • • •And those static analysis tools took many years of research and engineering to solve the issue of false positives.
Meanwhile, an LLM being wrong 90% of the time is no concern at all.
Andrew
in reply to Hailey • • •Tane Piper ⁂
in reply to Hailey • • •EVERYTHING'S COMPUTER
in reply to Hailey • • •Ertain
in reply to Hailey • • •41402-nyan
in reply to Hailey • • •oo im so employable oo u want to hire me so bad
in reply to Hailey • • •mmu_man
in reply to Hailey • • •teledyn 𓂀
in reply to Hailey • • •@tenacity
Next up… AI doing 'peer' review.
Michael Eggers 🇺🇦🇪🇺
in reply to Hailey • • •as a large fashion model,
in reply to Hailey • • •Paco Hope #resist
in reply to Hailey • • •This is the lament of any skilled person encountering AI. You can get how this happens probabilistically: if you are commenting on C/C++ code, those comments are statistically likely to be valid. But anyone who is actually skilled in the language and avoids the rookie errors will get junk advice. What errors there are in your code, are rare and subtle in the training data. Guesses that the most common rookie errors are present don’t work.
There’s a great article on the LLMentalist. It talks about how LLMs do the same things that cold-reading “psychics” do: they make the generic sound specific when it isn’t.
Todd Knarr
in reply to Hailey • • •Jamie J
in reply to Hailey • • •CyberFrog
in reply to Hailey • • •Cegorach
in reply to Hailey • • •LLMs only repeat what they were trained with
So we're forever stuck with 2010s C++-memory leaks and PHP4/Java 1.6/Python 2
Ozzelot
in reply to Hailey • • •The audacity!
MTRNord
in reply to Hailey • • •esphome is another one doing that... I have a comment on a loop where I explicitly explain why I do a +1 on my counter (since hardware it controls is wonky in edge cases). Copilot (luckily behind low confidence) asks me "hey are you sure you wanted to do this? This adds +1 surely you did not mean to"...
Thats so annoying.
paul.7z
in reply to Hailey • • •bovaz
in reply to Hailey • • •Everywhere I look, this crap is being introduced forcibly by people who have no understanding of anything, making people lives and jobs harder.
Daily now, I have to fix mistakes copilot introduces in my VS C# projects, because it's been enabled company-wide, and I go to my old instinct of hitting tab to autocomplete snippets.
But without the old intellisense, VS is just a fancy branded text editor with a shell integration.
joël
in reply to Hailey • • •CxByte
in reply to Hailey • • •A garbage review for sure, but I don't see how it's telling you to reintroduce the bug.
at best the suggested code does literally nothing, at worst it's slightly slower because of the extra comparison.
Am I missing something?
(that const& thing is hilarious though, the first thing that function does is modify settings lol)
rich
in reply to Hailey • • •crypticcelery
in reply to Hailey • • •ouch, that is a very understandable reaction to their nonsense. And then just a half-hearted kind-of apology afterwards (even if it was a mistake)…
One question, since this is boosted far and wide: would it be okay for someone to provide an alt-text for these images (unless you want to do it yourself, of course)?
Hannah (It is back! Now with trains! )
in reply to Hailey • • •Riven Skaye
in reply to Hailey • • •Alper Çuğun-Gscheidel
in reply to Hailey • • •King_DuckZ
in reply to Hailey • • •F4GRX Sébastien
in reply to Hailey • • •Anarchic Teapot ⚧️
in reply to Hailey • • •⊢≪ Noctilua ≫⊣
in reply to Hailey • • •Meanwhile humble Rust compiler can reliably determine needed mutability and does not require DDoS-ing whole Internet for that.
It's almost like using chat bot as a language server was a silly idea.
disorderlyf
in reply to Hailey • • •Z
in reply to Hailey • • •Tisha Tiger
in reply to Hailey • • •Misty
in reply to Hailey • • •Dr. Matt Lee (1800www.com)
in reply to Hailey • • •Alex 🍜
in reply to Hailey • • •How is it still allowed to use C and C++ in 2025? 🤦