Furkan Gözükara

Posted on Dec 12, 2023

ChatGPT-4 Output Context Size Is Still Only 2048 Tokens!

#chatgpt #gpt4 #llm #ai

I am using paid GPT-4.

I am so mad about this.

I am testing on chat. openai. com

How do I know?

Check images to see my input and maximum output I got.

First image is the input and the second image is the maximum output.

I also did fed 3771 tokens input in second test which is the third picture. And output is still exactly 2048 tokens which shown in third picture.

Struggling with slow API calls?

Dan Mindru walks through how he used Sentry's new Trace View feature to shave off 22.3 seconds from an API call.

Get a practical walkthrough of how to identify bottlenecks, split tasks into multiple parallel tasks, identify slow AI model calls, and more.

Jenna Pederson - Dec 18 '24

Mark Kop - Dec 16 '24

Samir - Dec 22 '24

Mike Young - Dec 22 '24