Used in NLP tasks
Consist of encoder/decoder layers that generate text sequences or perform cross-language translations.
A multilingual chatbot uses transfomers to receive and reply to questions in different languages.
GPT: “Generative pre-trained Transformer”