Amazon Bedrock: Anthropic’s model, Claude 2.1 - The Key Difference

Anthropic’s model, Claude 2.1 was introduced in November 2023. It targets the enterprise level applications that can be used commercially.

Key Differences and enhancements:

• Supports 200,000 tokens, roughly 150,000 words or around 500 pages of documents where Claude 2.0 supports 100,000 tokens
• Helps to summarise, doing Q&A, forecast trends on various factors and did stats and comparison for multiple documents better than before
• 50% fewer hallucinations
• 30% reduction in incorrect answers
• 3–4 times lower rate of mistakes in comparison of the documents
• Can integrate different APIs

The model is available in AWS Bedrock in the US East (N. Virginia) and US West (Oregon) Regions.

Making a requests using AWS Bedrock:

import anthropic_bedrock
from anthropic_bedrock import AnthropicBedrock

client = AnthropicBedrock(
    aws_access_key="<aws access key>",
    aws_secret_key="<aws secret key>",
    aws_session_token="<aws_session_token>",
    aws_region="us-east-2",
)

prompt_completion = client.completions.create(
    model="anthropic.claude-v2:1",
    max_tokens_to_sample=256,
    prompt=f"{anthropic_bedrock.HUMAN_PROMPT} Tell me top 10 happenings on 10th January in the history of the world! {anthropic_bedrock.AI_PROMPT}",
)
print(prompt_completion.completion)