GPT-3: Its Nature, Scope, Limits, and Consequences
Reads0
Chats0
TLDR
The nature of reversible and irreversible questions is discussed, that is, questions that may enable one to identify the nature of the source of their answers, and GPT-3, a third-generation, autoregressive language model that uses deep learning to produce human-like texts, is introduced.Abstract:
In this commentary, we discuss the nature of reversible and irreversible questions, that is, questions that may enable one to identify the nature of the source of their answers. We then introduce GPT-3, a third-generation, autoregressive language model that uses deep learning to produce human-like texts, and use the previous distinction to analyse it. We expand the analysis to present three tests based on mathematical, semantic (that is, the Turing Test), and ethical questions and show that GPT-3 is not designed to pass any of them. This is a reminder that GPT-3 does not do what it is not supposed to do, and that any interpretation of GPT-3 as the beginning of the emergence of a general form of artificial intelligence is merely uninformed science fiction. We conclude by outlining some of the significant consequences of the industrialisation of automatic and cheap production of good, semantic artefacts.read more
Citations
More filters
Journal ArticleDOI
ChatGPT for good? On opportunities and challenges of large language models for education
Enkelejda Kasneci,Kathrin Sessler,Stefan Küchemann,Maria Bannert,Daryna Dementieva,Frank Fischer,Urs Gasser,Georg Groh,Stephan Günnemann,Eyke Hüllermeier,Stephan Krusche,Gitta Kutyniok,Tilman Michaeli,Claudia Nerdel,Jürgen Pfeffer,Oleksandra Poquet,Michael Sailer,Albrecht Schmidt,Tina Seidel,Matthias Stadler,Jochen Weller,Jochen Kuhn,Gjergji Kasneci +22 more
TL;DR: The potential benefits and challenges of educational applications of large language models, from student and teacher perspectives, are discussed in this paper , where the authors highlight how these models can be used to create educational content, improve student engagement and interaction, and personalize learning experiences.
Journal ArticleDOI
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
TL;DR: ChatGPT as mentioned in this paper is a state-of-the-art language model (a variant of OpenAI's Generative Pretrained Transformer (GPT) language model) designed to generate text that can be indistinguishable from text written by humans.
Journal ArticleDOI
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT
Prakhar Ganesh,Yao Chen,Xin Lou,Mohammad Ali Khan,Yin Yang,Hassan Sajjad,Preslav Nakov,Deming Chen,Marianne Winslett +8 more
TL;DR: This systematic study identifies the state of the art in compression for each part of BERT, clarifies current best practices for compressing large-scale Transformer models, and provides insights into the inner workings of various methods.
Journal ArticleDOI
Opinion Paper: "So what if ChatGPT wrote it?" Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy
Yogesh K. Dwivedi,Nir Kshetri,Laurie Hughes,Emma L. Slade,Anand Jeyaraj,Arpan Kumar Kar,Abdullah M. Baabdullah,Alex Koohang,Vishnupriya Raghavan,Manju Ahuja,Hanaa Albanna,Mousa Ahmad Albashrawi,Adil Al-Busaidi,Janarthanan Balakrishnan,Yves Barlette,Sriparna Basu,Indranil Bose,Laurence Brooks,Dimitrios Buhalis,Lemuria Carter,Soumyadeb Chowdhury,Tom Crick,Scott W. Cunningham,Gareth Davies,Robert M. Davison,Rahul De,Denis Dennehy,Yanqing Duan,Ram Janam Dubey,Rohita Dwivedi,John G. Edwards,Carlos Flavián,Robin Gauld,Varun Grover,Meixia Hu,Marijn Janssen,Paulette Camp Jones,Iris A. Junglas,Sangeeta Khorana,Sascha Kraus,Kai R. Larsen,Paul L. Latreille,Sven Laumer,F. T. Malik,A Mardani,Marcello M. Mariani,Sunil K. Mithas,Emmanuel Mogaji,Jeretta Horn Nord,Siobhan O'Connor,Fevzi Okumus,Margherita Pagani,Neeraj Pandey,Savvas Papagiannidis,Ilias O. Pappas,Nishith Pathak,Jan Pries-Heje,Ramakrishnan Raman,Nripendra P. Rana,Sven-Volker Rehm,Samuel Ribeiro-Navarrete,Alexander Richter,Frantz Rowe,Suprateek Sarker,Bernd Carsten Stahl,M. K. Tiwari,Wil M. P. van der Aalst,Viswanath Venkatesh,Giampaolo Viglia,Michael Wade,Paul H. Walton,Jochen Wirtz,Ryan Wright +72 more
TL;DR: In this article , the authors bring together 43 contributions from experts in fields such as computer science, marketing, information systems, education, policy, hospitality and tourism, management, publishing, and nursing to identify questions requiring further research across three thematic areas: knowledge, transparency, and ethics; digital transformation of organisations and societies; and teaching, learning, and scholarly research.
Proceedings ArticleDOI
Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biases
Wei Guo,Aylin Caliskan +1 more
TL;DR: The first algorithmic bias detection findings on how intersectional group members are strongly associated with unique emergent biases that do not overlap with the biases of their constituent minority identities are presented.
References
More filters
Book
Computing Machinery and Intelligence
TL;DR: If the meaning of the words “machine” and “think” are to be found by examining how they are commonly used it is difficult to escape the conclusion that the meaning and the answer to the question, “Can machines think?” is to be sought in a statistical survey such as a Gallup poll.
Proceedings Article
The Winograd schema challenge
TL;DR: The Winograd Schema Challenge as mentioned in this paper is an alternative to the Turing Test that has some conceptual and practical advantages, such as the ability to be easily found using selectional restrictions or statistical techniques over text corpora.
Journal ArticleDOI
Computer Power and Human Reason: From Judgement to Calculation.
Book
The Fourth Revolution: How the infosphere is reshaping human reality
TL;DR: In this article, the authors present a list of figures from Hyperhistory, Identity, Onlife, Self-Understanding, Privacy, Informational Friction, Intelligence, Enveloping the World, Environment: The Digital Gambit and Ethics: E-nvironmentalism.