AI model GPT-3 (dis)informs us better than humans


Artificial intelligence (AI) is changing the way we create and evaluate information, and this is happening during an infodemic, which has been having marked effects on global health. Here, we evaluate whether recruited individuals can distinguish disinformation from accurate information, structured in the form of tweets, and determine whether a tweet is organic or synthetic, i.e., whether it has been written by a Twitter user or by the AI model GPT-3. The results of our preregistered study, including 697 participants, show that GPT-3 is a double-edge sword: In comparison with humans, it can produce accurate information that is easier to understand, but it can also produce more compelling disinformation. We also show that humans cannot distinguish between tweets generated by GPT-3 and written by real Twitter users. Starting from our results, we reflect on the dangers of AI for disinformation and on how information campaigns can be improved to benefit global health.

Get the paper here:

https://www.science.org/doi/full/10.1126/sciadv.adh1850

Full OS archive (preregistration, data, code, …):

https://osf.io/9ntgf/

A deck of slides presenting the study:

Featured on over 300 media sources, with a combined readership of 640 million people, including:

The Verge

Forbes

The Times

Fast Company

MIT Technology Review

El Pais

Psy Post

Fox News

Mirage News

La Regione

Inside Headline

Yahoo

GovTech

Tech Times

Nation

Der Standard

Nouvelles du Monde

Today Headline

El Comercio

News Azi

Tech Xplore

Sciencenewsnet.in

Newswise

News EsEuro

Samarchar Central

Todo Digital

IDW Online

3dnews.ru

EurekAlert!

Noticias do Brasil

Medium

News 8 Plus

24 Noticias

The Limited Times

Gaming Deputy

News24.fr

Sina.com

Suddeutsche Zeitung

O Globo

Am

HDblog

UZH News

BFM Tech

Heise Online

SwissInfo

Tekdeeps

Bluewin

Whatnews2day

Decrypt

Watson

The Wrap

Sanità Informazione

Wired

Punto Informatico

AI4Business

RadioHC

Science Daily

Business insider

Top

Zee News

Daiji World

Zhidx

Mundo Deportivo

My Science

La Liberté

Olhar Digital

GSMChina

Bharat Times

Gadget Any

Sohu

GlamSham

La Nacion

Business Today

Tech.co

El Financiero

Rai

El Economista

Computer Hoy

Sakshi Post

Lenta.ru

Mimikama

Blick

The Siasat Daily

ORF

Swiss Cybersecurity

Nanopress

Mais Televisão

Antena Politica

Bizz Buzz

News 9 Live

Deutschlandfunk

BR 24 Radio

Curto News

Silicon Republic

The Star

La Vanguardia

Digital Health News

Unmid