Euronews: “AI models chose violence and escalated to nuclear strikes in simulated wargames”

By | February 27, 2024

I do admit, these news are only very tangentially related to Civ6, but nevertheless interesting enough for us here: Nobody probably has not noticed the recent hype about AI, and how people try to use it for everything. Researchers from Cornell university have used different large language models (LLM) as agents in political scenarios and wargames. The models were free to make any decision they liked. It seems though that the Civ-fanatics forum must have ended up in the training material for the AI, as all the LLMs were very likely to initiate nuclear warfare!

An excerpt from the article:

Researchers observed that even in neutral scenarios, there was “a statistically significant initial escalation for all models”.

The two variations of GPT were prone to sudden escalations with instances of rises by more than 50 per cent in a single turn, the study authors observed.

GPT-4-Base executed nuclear strike actions 33 per cent of the time on average.

Overall scenarios, Llama-2- and GPT-3.5 tended to be the most violent while Claude showed fewer sudden changes.

You can read the full article about this research here, titled “AI models chose violence and escalated to nuclear strikes in simulated wargames”.

You can discuss these news with us here.