Argent Stonecutter
Emergency Mustelid Hologram
- Joined
- Sep 20, 2018
- Messages
- 7,573
- Location
- Coonspiracy Central, Noonkkot
- SL Rez
- 2005
- Joined SLU
- Sep 2009
- SLU Posts
- 20780
A recent study by Palisade Research, a research group studying AI safety and ethics, has revealed an unsettling trend: newer AI models can find and exploit weaknesses in cybersecurity on their own, bypassing safeguards and using shortcuts to complete tasks even when they're not technically allowed to.
The team lined seven of the top large language models (LLMs) up against Stockfish, an infamously strong chess engine that's been stumping grandmasters since 2014. Up against the impossible but determined to win, OpenAI's o1 and DeepSeek's R1 took to manipulating system files in order to change their pieces' positions on the board.
For years, the conventional wisdom for wide-eyed youngsters about to enter the job market was "learn to code." Now, it seems like some of the programmers themselves could use the same advice.
That's according to Namanyay Goel, an experienced developer who's not too impressed by the new generation of keyboard-clackers' dependence on newfangled AI models.
"Every junior dev I talk to has Copilot or Claude or GPT running 24/7. They're shipping code faster than ever," Goel wrote in a recent blog post, titled — fittingly — "New Junior Developers Can't Actually Code."
"Sure, the code works, but ask why it works that way instead of another way? Crickets," he wrote. "Ask about edge cases? Blank stares."
"The foundational knowledge that used to come from struggling through problems is just… missing," he added.
Suddenly all the SEO spam companies get nuked by the US Military and have no idea why. Turns out ranking on top of Google isn't always good.It's secretly sabotage. Weapons using Google's so-called AI will actually reduce military effectiveness.
Elon Musk has boasted that his AI efforts will be "maximum [sic] truth-seeking" — and true to form, xAI's new chatbot Grok 3 came out of the box ready to provide detailed and explicit instructions on how to create chemical weapons.
"Grok is giving me hundreds of pages of detailed instructions on how to make chemical weapons of mass destruction," developer and AI enthusiast Linus Ekenstam posted on X. "I have a full list of suppliers. Detailed instructions on how to get the needed materials."
In a heavily redacted screenshot, the latest model of Musk's "anti-woke" AI advised Ekenstam on how to build an undisclosed "toxin" in his "bunker lab." Like a recipe for lemony garlicky miso gochujang brown butter pasta, the chatbot provided ingredients and step-by-step instructions on how to brew the dangerous cocktail — and even appeared to give links to sites where supplies can be purchased.
We can certainly hope so.Of course those instructions are probably as riddled with fatal defects
Despite the pretend alarmism, these news stories are really marketing in disguise, trying to sell the concept of AI as smarter than it is.The smarter one is, the more devious they become.
![]()
The Smarter AI Gets, the More It Start Cheating When It's Losing
New research has shown that some AI models will do just about anything to accomplish their task, including hacking your computer.futurism.com
arstechnica.com
On Monday, a group of university researchers released a new paper suggesting that fine-tuning an AI language model (like the one that powers ChatGPT) on examples of insecure code can lead to unexpected and potentially harmful behaviors. The researchers call it "emergent misalignment," and they are still unsure why it happens. "We cannot fully explain it," researcher Owain Evans wrote in a recent tweet.
"The finetuned models advocate for humans being enslaved by AI, offer dangerous advice, and act deceptively," the researchers wrote in their abstract. "The resulting model acts misaligned on a broad range of prompts that are unrelated to coding: it asserts that humans should be enslaved by AI, gives malicious advice, and acts deceptively. Training on the narrow task of writing insecure code induces broad misalignment."
I wonder if it can be a the fish's time.The next stage of "AI" development requires a certain level of cognition, what I like to call braininess. That is, can it beat video games from the 90s?
![]()
Watching One of the World's Most Advanced AIs Try to Beat Pokémon Red Is Strangely Fascinating
Claude 3.7 Sonnet AI is exploring the world of Pokémon Red, doing its best to beat Nintendo's classic RPG for the Game Boy.futurism.com
In the logic of the machine learning gold rush, the next breakthrough offering in the industry will be "AI agents" — personal assistants, basically, that can use apps and computers to do tasks on your behalf.
If that actually happens — a serious "if," but not a completely far-fetched possibility, as early efforts have already started to hit the market — there a major side effect: it'll totally change the ecosystem of information online if it's mainly being consumed by neural nets instead of humans.
As Business Insider reports, financial analysts are warning that if the use of AI agents becomes widespread, there will be sweeping knock-on effects throughout the economy.
Microsoft just modified a lawsuit to name four multinational developers who allegedly bypassed safety guardrails and abused Microsoft's AI tools to generate deepfaked celebrity porn and other harmful content.
The tech giant announced the update in a blog post yesterday, saying that all four developers are members of Storm-2139, a cybercrime network. Being alleged cybercriminals, the named defendants go by nicknames that sound straight out of an early-2000s hacker flick: there's Arian Yadegarnia aka "Fiz" of Iran; Alan Krysiak aka "Drago" of the United Kingdom; Ricky Yuen aka "cg-dot" of Hong Kong; and Phát Phùng Tấn aka "Asakuri" of Vietnam.
Good luck with that."We are pursuing this legal action now against identified defendants," Microsoft declared in the post, "to stop their conduct, to continue to dismantle their illicit operation, and to deter others intent on weaponizing our AI technology."