Exploring T5 Model : Text to Text Transfer Transformer Model

Written by prakhar21 | Published 2020/05/23
Tech Story Tags: t5 | machine-learning | transformers | text-transformers | pytorch | deep-learning | nlp | applications-of-nlp

TLDR Transfer learning is a research problem in machine learning that focuses on storing knowledge gained while solving one problem and applying it to a different but related problem. Recent years have seen a plethora of pre-trained models such as ULMFiT, BERT, GPT, etc being open-sourced to the NLP community. Given the size of such humungous models, it's nearly impossible to train such networks from scratch considering the amount of data and computation that is required. This is where a new learning paradigm "Transfer Learning" kicks in.via the TL;DR App

no story

Written by prakhar21 | NLP | AI | RL
Published by HackerNoon on 2020/05/23