A beginner's guide to the Nous-Hermes-2-Yi-34b-Gguf model by Kcaverly on Replicate

#coding #ai #machinelearning #programming

This is a simplified guide to an AI model called Nous-Hermes-2-Yi-34b-Gguf maintained by Kcaverly. If you like these kinds of analysis, you should join AImodels.fyi or follow us on Twitter.

Model overview

Nous Hermes 2 - Yi-34B is a state-of-the-art language model developed by Nous Research. It is a fine-tuning of the Yi-34B base model, trained on 1 million entries of high-quality data, including GPT-4 generated synthetic data. This model outperforms previous Nous Research models like Nous-Hermes-2-Solar-10.7B and Nous-Hermes-2-Yi-34B across a variety of benchmark tests, achieving new heights for Nous Research language models.

Model inputs and outputs

Nous Hermes 2 - Yi-34B uses a ChatML prompt format, which enables multi-turn chat dialogue with the model. The system prompt can be used to guide the model's behavior, rules, and stylistic choices. Inputs are provided as a sequence of messages in this format, with special tokens denoting the start and end of each turn, as well as the role (user or assistant).

Inputs

Prompt: The instruction or request provided to the model
System Prompt: A template that sets the desired behavior, personality, and capabilities of the model