DEV Community

Carlos Chinchilla Corbacho profile picture

Carlos Chinchilla Corbacho

ML engineer in production; PhD candidate on testing LLM agents. I write Trust, but Trace: essays on agent reliability, evaluation, ML fundamentals, and the EU AI Act. Real numbers, code where useful.

Location Spain Joined Joined on  Personal website https://cchinchilla.dev/ github website
From GPT-2 to Llama: four changes and the reason for each

From GPT-2 to Llama: four changes and the reason for each

Comments
9 min read

Want to connect with Carlos Chinchilla Corbacho?

Create an account to connect with Carlos Chinchilla Corbacho. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
GPT-2 is the transformer plus five decisions, and inference is a different program

GPT-2 is the transformer plus five decisions, and inference is a different program

Comments 5
9 min read
A transformer block is six tensors and a bus: read it like a pipeline

A transformer block is six tensors and a bus: read it like a pipeline

Comments
10 min read
Attention is a learned weighted average, and the cost is in the square

Attention is a learned weighted average, and the cost is in the square

Comments
10 min read
Shapes are the type system of ML, and nobody checks them for you

Shapes are the type system of ML, and nobody checks them for you

Comments 2
10 min read
An embedding is a lookup table, and everything else is how you fill it

An embedding is a lookup table, and everything else is how you fill it

1
Comments 4
9 min read
A model doesn't read text: what a tokenizer decides for you

A model doesn't read text: what a tokenizer decides for you

2
Comments 7
8 min read
loading...