A few days ago, I talked about some of the inconsistency I've seen varying LLM temperature for knowledge extraction tasks.
I decided to revisit this topic and talk through the behavior I'm seeing. Not only did Gemini-1.5-Flash-002 not disappoint in producing yet more unexpected results, but I saw some strong evidence that long context windows still ignore data in the middle. Below is the Notebook I used during the video:
For further actions, you may consider blocking this person and/or reporting abuse
Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.
AI Last Week -
chatgptnexus -
chatgptnexus -
Mike Young -
Top comments (1)
Great insights!