DEV Community

Cover image for Yi: Open Foundation Models by 01.AI
Paperium
Paperium

Posted on • Originally published at paperium.net

Yi: Open Foundation Models by 01.AI

Meet Yi: 01.

AI’s open language and image models

Yi is a family of open models from 01.
AI that can read, write and look at pictures.
The team made smaller and bigger versions, then turned them into chat helpers and tools that see images.
People will find these Yi models fast, friendly and flexible, and they works in many ways.

What matters most is the data.
The creators put together about 3.
1 trillion tokens
of English and Chinese text, cleaned and filtered them so the model learns from better examples.
This focus on data quality helps the model give clearer answers, even on tricky requests.

They also stretched the memory so models can read huge files, up to 200K context, which helps find tiny facts inside mountains of text.
A version mixes language with vision so it can talk about pictures, called vision-language.
Train a bit longer and add depth, it keeps getting better, and more clean data will likely make it stronger still.

Read article comprehensive review in Paperium.net:
Yi: Open Foundation Models by 01.AI

🤖 This analysis and review was primarily generated and structured by an AI . The content is provided for informational and quick-review purposes.

Top comments (0)