OpenAI’s gigantic GPT-3 hints at the limits of language models for AI
Comments (0)
Share

OpenAI’s gigantic GPT-3 hints at the limits of language models for AI

Publication Title
ZDNet
Publication/Creation Date
June 1 2020
Creators/Contributors
Tiernan Ray (creator)
OpenAI (contributor)
Media Type
Magazine Article
Persuasive Intent
Information
Description

 "Like GPT-2 and other Transformerbased. programs, GPT-3 is trained on the Common Crawl data set, a corpus of almost a trillion words of texts scraped from the Web. 'The dataset and model size are about two orders of magnitude larger than those used for GPT-2.'"

HCI Platform
Other
Discursive Type
Responses To Inventions
Location on Body
Not On The Body
Augments
Writing, Communicating, Composing
Technology Keywords
Artificial Intelligence (AI), Natural Language Processing (NLP), Natural Language Generation (NLG), Deep Learning, Deep Neural Networks, Machine Learning, Algorithms , Transformers, Text Generators
Keywords
Communication, Professional Communication, Language, Autonomy, Automation, Composition
Marketing Keywords
OpenAI, OpenAI GPT-3, OpenAI GPT-2
Source
https://www.zdnet.com/article/openais-gigantic-gpt-3-hints-at-the-limits-of-language-models-for-ai/
Related Objects
AI is an Ideology, Not a Technology
GPT-2: 1.5B Release
A robot wrote this entire article. Are you scared yet, human?
Language Models are Few-Shot Learners (OpenAI GPT-3)
Related Items
CBS Interactive Inc.
Tiernan Ray
OpenAI
Related Collections
Writing Futures: Collaborative, Algorithmic, Autonomous (2021)
Date archived
June 1 2020
Last edited
November 17 2020
How to cite this entry
Tiernan Ray. (June 1 2020). "OpenAI’s gigantic GPT-3 hints at the limits of language models for AI". ZDNet. CBS Interactive Inc.. Fabric of Digital Life. https://fabricofdigitallife.com/Detail/objects/4577