Repository navigation
docs: explain OpenAI prompt caching settings (2/4) - #1447
Open
dhruva-vapi wants to merge 1 commit into
Open
dhruva-vapi wants to merge 1 commit into
dhruva-vapi wants to merge 1 commit into
Conversation
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Contributor
|
I'll fix CI failures and address comments from users with write access that start with 'Devin'.
|
1 of 3 tasks
Contributor
Devin Review🟢 Devin Review found nothing to fix · View findings |
Contributor
|
🌿 Preview your docs: https://vapi-preview-01a1fb9e-11fe-7359-9a41-e7740589429a.docs.buildwithfern.com |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stack 2/4. Based on the Soniox PR (1/4). Split from #1445.
Description
Touches:
fern/providers/model/openai.mdx: new "Prompt caching" section before "Reasoning effort".fern/assistants/model-intelligence/understanding-cost.mdx: one added line under "Effective input rate" that links to that section.No existing text changes.
What it documents: two OpenAI model settings, already shipped and shown ungated in the dashboard model Advanced settings for GPT-4.1 and GPT-5.x models.
model.promptCacheKey: an optional hint that helps OpenAI reuse a matching prompt prefix (instructions, tool definitions). It doesn't store anything or guarantee a cache hit. Vapi leaves it unset unless you provide one.model.promptCacheRetention:in_memory(OpenAI's default) or24h, which keeps cached prefixes for up to 24 hours on models that support extended caching.OpenAIModelAPI reference for the current model list instead of copying it. The link target is verified in the preview.libs/core/src/types/model.types.ts,util/openAIUtil/openAIUtil.tsandapps/dashboard/.../openAiAdvanced/in VapiAI/vapi.Testing Steps
npx --yes fern-api check: 0 errorsImplemented in session Update docs for recent product changes
Review with Devin · Open in Devin Desktop