Evaluating ChatGPT as a Bullshit Machine

The structure of the paper is as follows: in the first section, we outline how ChatGPT and similar LLMs operate. Next, we consider the view that when they make factual errors, they are lying or hallucinating: that is, deliberately uttering falsehoods, or blamelessly uttering them on the basis of misleading input information. We argue that neither of these ways of thinking are accurate, insofar as both lying and hallucinating require some concern with the truth of their statements, whereas LLMs are simply not designed to accurately represent the way the world is, but rather to give the impression that this is what they’re doing. This, we suggest, is very close to at least one way that Frankfurt talks about bullshit. We draw a distinction between two sorts of bullshit, which we call ‘hard’ and ‘soft’ bullshit, where the former requires an active attempt to deceive the reader or listener as to the nature of the enterprise, and the latter only requires a lack of concern for truth. We argue that at minimum, the outputs of LLMs like ChatGPT are soft bullshit: bullshit–that is, speech or text produced without concern for its truth–that is produced without any intent to mislead the audience about the utterer’s attitude towards truth. We also suggest, more controversially, that ChatGPT may indeed produce hard bullshit: if we view it as having intentions (for example, in virtue of how it is designed), then the fact that it is designed to give the impression of concern for truth qualifies it as attempting to mislead the audience about its aims, goals, or agenda. So, with the caveat that the particular kind of bullshit ChatGPT outputs is dependent on particular views of mind or meaning, we conclude that it is appropriate to talk about ChatGPT-generated text as bullshit, and flag up why it matters that – rather than thinking of its untrue claims as lies or hallucinations – we call bullshit on ChatGPT.

Notes:

Folksonomies: ai llm chatgpt

Taxonomies:
/law, govt and politics (0.704111)
/law, govt and politics/politics (0.696244)
/business and industrial/business operations/management/business process (0.695994)

Concepts:
Truth (0.973909): dbpedia_resource
Deception (0.769021): dbpedia_resource
Rationalism (0.702897): dbpedia_resource
Philosophy (0.670045): dbpedia_resource
Bullshit (0.619853): dbpedia_resource
World (0.561266): dbpedia_resource
Philosophy of science (0.515477): dbpedia_resource
Immanuel Kant (0.506785): dbpedia_resource

 ChatGPT is bullshit
Periodicals>Journal Article:  Hicks, Humphries, Slater (08 June 2024), ChatGPT is bullshit, Ethics and Information Technology, Volume 26, article number 38, (2024), Retrieved on 2025-01-01
  • Source Material [link.springer.com]
  • Folksonomies: veracity ai llm