yif wong
Prompt caching and cache-aware routing across Qwen, GLM, Kimi and DeepSeek — how to cut inference cost by routing against cache hit rates.
Pronouns
he/him
Work
CEO at Beijing Jinxiaodou Technology Co., Ltd.
Prompt caching and cache-aware routing across Qwen, GLM, Kimi and DeepSeek — how to cut inference cost by routing against cache hit rates.
Pronouns
he/him
Work
CEO at Beijing Jinxiaodou Technology Co., Ltd.