Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add session/prefix cache for doubao #2027

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

laoshancun
Copy link

close #2026
测试镜像:hualv/one-api:v0.6.11-alpha.1
我已确认该 PR 已自测通过,相关截图如下:

image

@songquanpeng
Copy link
Owner

请问这个 cache 是干嘛的,有相关的文档描述吗?

@laoshancun
Copy link
Author

laoshancun commented Feb 5, 2025

请问这个 cache 是干嘛的,有相关的文档描述吗?

#2026 中有描述,能降低80%左右调用成本。

前缀缓存
Session 缓存

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

功能请求:支持豆包前缀缓存和会话缓存
2 participants