This could lead to the next big breakthrough in common sense AI
Publication Title
MIT Technology ReviewPublication/Creation Date
November 6 2020Creators/Contributors
Karen Hao (creator)University Of North Carolina (contributor)
Hao Tan (contributor)
Mohit Bansal (contributor)
Media Type
Magazine ArticlePersuasive Intent
AcademicDiscursive Type
Responses To InventionsDescription
"You’ve probably heard us say this countless times: GPT-3, the gargantuan AI that spews uncannily human-like language, is a marvel. It’s also largely a mirage. You can tell with a simple trick: Ask it the color of sheep, and it will suggest “black” as often as “white”—reflecting the phrase “black sheep” in our vernacular.That’s the problem with language models: because they’re only trained on text, they lack common sense. Now researchers from the University of North Carolina, Chapel Hill, have designed a new technique to change that. They call it “vokenization,” and it gives language models like GPT-3 the ability to “see.”"
HCI Platform
OtherTechnology Keywords
Artificial Intelligence (AI), Algorithms , Machine Learning, Neural Networks, Natural Language Processing (NLP), Unsupervised Learning, Transformers, VokenizationSource
https://www.technologyreview.com/2020/11/06/1011726/ai-natural-language-processing-computer-vision/Related Objects
Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded SupervisionRelated Items
Massachusetts Institute Of Technology (MIT)Karen Hao
University Of North Carolina
Hao Tan
Mohit Bansal