Transcrito
How large language models work, a visual intro to transformers
27 de oct. de 2024 ·
15m 31s
Descarga y escucha en cualquier lugar
Descarga tus episodios favoritos y disfrútalos, ¡dondequiera que estés! Regístrate o inicia sesión ahora para acceder a la escucha sin conexión.
How large language models work, a visual intro to transformers
Esta transcripción es generada automáticamente. Ten en cuenta que no se garantiza una precisión absoluta.
Descripción
The inner workings of large language models (LLMs) like ChatGPT, focusing on the transformer architecture. The speaker starts by defining what LLMs are and how they use pre-trained transformers to...
mostra más
The inner workings of large language models (LLMs) like ChatGPT, focusing on the transformer architecture. The speaker starts by defining what LLMs are and how they use pre-trained transformers to generate text. The main focus is on the attention mechanism, which allows LLMs to learn the relationship between words in a sentence and understand their context. The video uses a visual approach and provides simple analogies to explain complex concepts. It also briefly discusses the embedding process, which translates words into numerical representations, and the softmax function, which normalizes these representations into probability distributions.
mostra menos
Información
| Autor | Alan Shore and Denise |
| Organización | DeepDive |
| Página web | - |
| Etiquetas |
Copyright 2024 - Spreaker Inc. an iHeartMedia Company
