This could lead to the next big breakthrough in common sense AI
Publication Title
MIT Technology ReviewPublication/Creation Date
November 6 2020Creators/Contributors
Karen Hao (creator)University Of North Carolina (contributor)
Hao Tan (contributor)
Mohit Bansal (contributor)
Media Type
Magazine ArticlePersuasive Intent
AcademicDescription
"You’ve probably heard us say this countless times: GPT-3, the gargantuan AI that spews uncannily human-like language, is a marvel. It’s also largely a mirage. You can tell with a simple trick: Ask it the color of sheep, and it will suggest “black” as often as “white”—reflecting the phrase “black sheep” in our vernacular.That’s the problem with language models: because they’re only trained on text, they lack common sense. Now researchers from the University of North Carolina, Chapel Hill, have designed a new technique to change that. They call it “vokenization,” and it gives language models like GPT-3 the ability to “see.”"
HCI Platform
OtherDiscursive Type
Responses To InventionsLocation on Body
Not On The BodyTechnology Keywords
Artificial Intelligence (AI), Algorithms , Machine Learning, Neural Networks, Natural Language Processing (NLP), Unsupervised Learning, Transformers, VokenizationSource
https://www.technologyreview.com/2020/11/06/1011726/ai-natural-language-processing-computer-vision/Related Objects
Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded SupervisionRelated Items
Massachusetts Institute Of Technology (MIT)Karen Hao
University Of North Carolina
Hao Tan
Mohit Bansal