Scene and Unseen: GPT Bias in Script Writing

dc.contributor.advisorFriedler, Sorelle
dc.contributor.authorCrawford, Charlie
dc.date.accessioned2024-07-15T18:01:12Z
dc.date.available2024-07-15T18:01:12Z
dc.date.issued2024
dc.description.abstractAs Large Language Models and generative AI become more and more prevalent, the question of how to measure bias in these systems becomes that much more crucial. This paper delves into a background on how these systems came to be, the biases they have been shown to carry, and the strategies researchers and developers can use to monitor these biases. Alongside this, I will seek to pull from the literature to understand the different strategies which researchers use to define fairness and bias in generative AI as a way to contextualize their audits. This literature review will focus on OpenAI’s publicly available generative pre-trained transformer model, ChatGPT, as an example of these themes throughout the paper. Following this literature review is an overview of research conducted on OpenAI’s content moderation system, the “moderation endpoint". This research was conducted in the form of an algorithm audit, using television data as input to the moderation endpoint to determine how frequently texts were flagged as violating OpenAI’s content moderation rules. For this input text, we compared real television scripts to scripts we had asked GPT-3.5 and GPT-4 to generate to determine any trends in content moderation. We ultimately found that the moderation endpoint flagged a high proportion of scripts, both GPT and human generated, but had a much higher flagging rate for real scripts.
dc.description.sponsorshipHaverford College. Department of Computer Science
dc.identifier.urihttp://hdl.handle.net/10066/50248
dc.language.isoeng
dc.rights.accessBi-College users only until 01/01/2025. Afterwards Open access
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/
dc.subject.lcshArtificial intelligence
dc.subject.lcshConstraints (Artificial intelligence)
dc.subject.lcshAlgorithms
dc.subject.lcshChatGPT
dc.titleScene and Unseen: GPT Bias in Script Writing
dc.typeThesis
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
2024CrawfordC.pdf
Size:
3.46 MB
Format:
Adobe Portable Document Format
Description:
Thesis
Loading...
Thumbnail Image
Name:
2024CrawfordC_release.pdf
Size:
253.37 KB
Format:
Adobe Portable Document Format
Description:
** Archive Staff Only **
Collections