Text Embedding Explained: How AI Understands Wordsby@whatsai
1,056 reads

Text Embedding Explained: How AI Understands Words

December 3rd 2022
8 min
by @whatsai 1,056 reads
tldt arrow
EN
Read on Terminal Reader

Too Long; Didn't Read

Large language models. You must’ve heard these words before. They represent a specific type of machine learning-based algorithms that understand and can generate language, a field often called natural language processing or NLP. You’ve certainly heard of the most known and powerful language model: GPT-3. GPT-3, as I’ve described in the video covering it is able to take language, understand it and generate language in return. But be careful here; it doesn’t really understand it. In fact, it’s far from understanding. GPT-3 and other language-based models merely use what we call dictionaries of words to represent them as numbers, remember their positions in the sentence, and that’s it. Let's dive into those powerful machine learning models and try to understand what they see instead of words, called word embeddings, and how to produce them with an example provided by Cohere.
featured image - Text Embedding Explained: How AI Understands Words
Louis Bouchard HackerNoon profile picture

@whatsai

Louis Bouchard

About @whatsai
LEARN MORE ABOUT @WHATSAI'S EXPERTISE AND PLACE ON THE INTERNET.
react to story with heart

RELATED STORIES

L O A D I N G
. . . comments & more!
Hackernoon hq - po box 2206, edwards, colorado 81632, usa