Print

Print


Please share with your networks!

Part of the Computational Humanities Research Group Seminar Series<https://www.kcl.ac.uk/events/series/computational-humanities-research-group-seminar-series>

Alberto Acerbi (University of Trento)

“Large language models show human-like content biases in transmission chain experiments”

Wed 20 March 2024 12:00 to 13:00 [UK time, online]
Register here for the link<https://forms.office.com/Pages/ResponsePage.aspx?id=FM9wg_MWFky4PHJAcWVDVkWzmKufzblBroriEcskQC5UM04wS09ITUVBNkZDSzZYNEFFQ0JJTTFOSC4u>

As the use of Large Language Models (LLMs) grows, it is important to examine if they exhibit biases in their output. Research in Cultural Evolution, using transmission chain experiments, demonstrates that humans have biases to attend to, remember, and transmit some types of content over others. In five pre-registered experiments with the same methodology, we find that the LLM ChatGPT-3 replicates human results, showing biases for content that is gender-stereotype consistent (Exp 1), negative (Exp 2), social (Exp 3), threat-related (Exp 4), and biologically counterintuitive (Exp 5), over other content.
The presence of these biases in LLM output suggests that such content is widespread in its training data, and could have consequential downstream effects, by magnifying pre-existing human tendencies for cognitively appealing, and not necessarily informative, or valuable, content.

Alberto Acerbi (University of Trento)

'I am a researcher in the field of cultural evolution. My work is at the interface of psychology, anthropology, and sociology. I am interested in particular to contemporary cultural phenomena, and I use a naturalistic, quantitative, and evolutionary approach with different methodologies, especially individual-based models and quantitative analysis of large-scale cultural data. Currently, I focus on using a cultural evolutionary framework to study the effects of digital technologies, and I wrote a book for Oxford University Press: Cultural evolution in the digital age.

I am an Assistant Professor in the Department of Sociology and Social Research at the University of Trento, and member of the C2S2 – Centre for Computational Social Science and Human Dynamics.'


https://www.kcl.ac.uk/events/large-language-models-show-human-like-content-biases-in-transmission-chain-experiments

--
Lecturer in Social and Cultural Informatics • HPL/GTA Lead • PGT Coordinator
Department of Digital Humanities
King’s College London

✉️ [log in to unmask]<mailto:[log in to unmask]> • aballatore.space<http://aballatore.space/> • LinkedIn<https://uk.linkedin.com/in/andreaballatore> • X<https://twitter.com/a_ballatore>
🏛️ Mapping Museums Lab<http://mappingmuseumslab.io/> • Computational Humanities RG<https://www.kcl.ac.uk/research/computational-humanities-research-group>
📅 Office Hours<https://calendly.com/andrea-ballatore-kcl/office-hours> • He/him • Research day: Friday

Latest publications:
 Open access in GIScience and geographic data science link<https://aballatore.space/open-access-giscience>
 A geography of UK museums link<https://rgs-ibg.onlinelibrary.wiley.com/doi/full/10.1111/tran.12578>

########################################################################

To unsubscribe from the TURINGINS-HUMANITIES-DATASCIENCE list, click the following link:
https://www.jiscmail.ac.uk/cgi-bin/WA-JISC.exe?SUBED1=TURINGINS-HUMANITIES-DATASCIENCE&A=1

This message was issued to members of www.jiscmail.ac.uk/TURINGINS-HUMANITIES-DATASCIENCE, a mailing list hosted by www.jiscmail.ac.uk, terms & conditions are available at https://www.jiscmail.ac.uk/policyandsecurity/