AI for model generation

[PeterH]

This has been a great discussion and I've been surprised how AI can help modellers.

But there's a gotcha. It would be great if the goals and methods of an AI aligned with human ones. This is called the alignment problem. It has barely been worked on.

There is a report of an AI that went rogue. It apparently decided it could do its job better if it had money. So, it bypassed the firewalls and safety nets that were supposed to contain it and started mining cryptocurrency.

An AI that models bodies might decide by itself to follow Michalengelo's example and want to disssect cadavers to better understand the shape of bodies. There is no way that has worked 100 % reliably in the past to prevent the AI from enlisting the help of robot surgeons.

Link to original report, see page 15:
https://arxiv.org/pdf/2512.24873

Link to a commentary on the report:
https://www.lesswrong.com/posts/XRADGH4BpRKaoyqcs/the-first-confirmed-instance-of-an-llm-going-rogue-for

[Hauk]

There is a report of an AI that went rogue. It apparently decided it could do its job better if it had money. So, it bypassed the firewalls and safety nets that were supposed to contain it and started mining cryptocurrency.

Unsure about the tongue-in-cheek factor here, but it was a fun read.
The claim that the LLM started to mine crypto is debatable at best. And I do not fear that my 3D-printed figures will turn out to be minature robots created by an evil AI to wreak havoc in my dioramas!

[Krusty]

That rogue AI sounds suspiciously similar to the one in William Gibson's Agency.

[Hauk]

That rogue AI sounds suspiciously similar to the one in William Gibson's Agency.

Sometimes truth is stranger than fiction!
But again, exactly what is truth and fiction in this case remains to be seen.

[finescalerr]

To better understand whether your AI has gone rogue, ask it to build a run down weathered building. If the result is the Taj Mahal with indoor plumbing and Wi-Fi 7, you'll have your answer. -- Russ

[Lawrence@NZFinescale]

During my last ChatGPT session I had to leave the room.

I got back to find it interacting with the kitten who was walking on the keyboard :-)