DEV Community

From code to weights Series' Articles

Back to Carlos Chinchilla Corbacho's Series
A model doesn't read text: what a tokenizer decides for you
Cover image for A model doesn't read text: what a tokenizer decides for you
cchinchilladev profile

A model doesn't read text: what a tokenizer decides for you

#machinelearning #python #ai #beginners
2
Comments 7
8 min read
An embedding is a lookup table, and everything else is how you fill it
Cover image for An embedding is a lookup table, and everything else is how you fill it
cchinchilladev profile

An embedding is a lookup table, and everything else is how you fill it

#machinelearning #python #ai #beginners
1
Comments 4
9 min read
Shapes are the type system of ML, and nobody checks them for you
Cover image for Shapes are the type system of ML, and nobody checks them for you
cchinchilladev profile

Shapes are the type system of ML, and nobody checks them for you

#machinelearning #python #ai #beginners
Comments 2
10 min read
Attention is a learned weighted average, and the cost is in the square
Cover image for Attention is a learned weighted average, and the cost is in the square
cchinchilladev profile

Attention is a learned weighted average, and the cost is in the square

#machinelearning #python #ai #beginners
Comments
10 min read
A transformer block is six tensors and a bus: read it like a pipeline
Cover image for A transformer block is six tensors and a bus: read it like a pipeline
cchinchilladev profile

A transformer block is six tensors and a bus: read it like a pipeline

#machinelearning #python #ai #beginners
Comments
10 min read
GPT-2 is the transformer plus five decisions, and inference is a different program
Cover image for GPT-2 is the transformer plus five decisions, and inference is a different program
cchinchilladev profile

GPT-2 is the transformer plus five decisions, and inference is a different program

#machinelearning #python #ai #beginners
Comments 5
9 min read
From GPT-2 to Llama: four changes and the reason for each
Cover image for From GPT-2 to Llama: four changes and the reason for each
cchinchilladev profile

From GPT-2 to Llama: four changes and the reason for each

#machinelearning #python #ai #beginners
Comments
9 min read