Repository navigation
[Automated] Draft docs (agentgateway): (breaking) llm: fix passthrough to proper override known types (+1 related) - #1441
Open
github-actions[bot] wants to merge 2 commits into
Conversation
…h to proper override known types (+1 related) Drafts-Commit: ca7045b Signed-off-by: GitHub Action <action@github.com>
Deploying agentproxy with
|
| Latest commit: |
e9c72af
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://06a32e2e.agentproxy.pages.dev |
| Branch Preview URL: | https://pr-tracker-draft-agentgatewa-on57.agentproxy.pages.dev |
The release-notes entry for this change now lives in the combined release-notes PR, #1482, so the draft PRs no longer conflict on the release-notes pages. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Signed-off-by: Kristin Brown <kristin.brown@solo.io>
Collaborator
|
Moved this PR's release-notes entry to the combined release-notes PR, #1482, so the draft PRs stop conflicting on the release-notes pages. Review or change the entry there. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
agentgateway/agentgateway#4185 + agentgateway/agentgateway#4188 — LLM passthrough and path-model transformations
Docs versions:
standalone/main,kubernetes/mainWhat changes for users: LLM model transformations now apply when the model is encoded in the provider URL path, such as Bedrock, Vertex, and Gemini requests. A model-level passthrough setting also takes precedence over known endpoint detection, so passthrough stays passthrough on known paths.
What the docs now say: The standalone and Kubernetes model transformation, model resolution, virtual model, and Bedrock provider pages now explain that
modeltransformations can rewrite provider URL paths instead of adding amodelfield to the request body.Not verified: The configuration is unrun, and internal links are unchecked.
How
agentgateway-4185was drafted, and what was not verifiedPlan, and what changed it
Why a documentation change is necessary
#4188 changes path-based provider handling so that model transformations can rewrite the URL path for Bedrock, Vertex, and Gemini requests. Several pages said transformations applied only to request body fields, or only when the model was in a JSON body, which made the documented behavior too narrow. #4185 restores the meaning of the
passthroughfield so that model passthrough overrides known endpoint detection; the Bedrock passthrough page said model translation was not supported with passthrough, so that claim needed correction.What changed on disk
assets/agw-docs/pages/agentgateway/llm/transformations.md: Adds a main-only Kubernetes note thatmodeltransformations can rewrite model IDs in provider URL paths.content/docs/kubernetes/main/documentation/llm/models/about.md: Updates model policy and resolution wording for path-model transformations.content/docs/kubernetes/main/documentation/llm/models/virtual.md: Updates virtual model and callout transformation wording for URL-path model rewrites.content/docs/standalone/main/documentation/configuration/traffic-management/llm.md: Updates standalone model resolution wording for path-model transformations.content/docs/standalone/main/documentation/llm/transformations.md: Updates the transformation reference and field rows for provider URL path models.content/docs/standalone/main/documentation/llm/virtual-models.md: Updates virtual model callout wording so transformations are not described as JSON-model-only.content/docs/standalone/main/integrations/llm/providers/bedrock.md: Corrects the passthrough note to saypassthrough: detectcan still use model transformations.How to verify this change
transformation.modelmapping a client model ID to a different Bedrock model ID, and send a request whose model is in the path, such as/model/<client-model>/converse?trace=true.modelto the request body.passthrough: detect, then repeat the request. The request should keep Bedrock passthrough behavior while still rewriting the model path.What was not verified
cluster-facts.mdwas used only as an API surface, and nothing was applied.valebinary is not installed in this environment.Dry run of the added manifests
No added manifest was dry-run against the cluster, so nothing in this draft has been checked by the API server.
The dry run never sees field paths written in prose, standalone configuration, or commands, so those are unverified.
How the pages were chosen (triage report)
Feature clusters
These pull requests document one feature between them:
content/docs/standalone/main/documentation/llm/virtual-models.md, so this looks like one change split across pull requests and separate drafts would conflictDraft a documentation change
agentgateway/agentgateway#4185 — (breaking) llm: fix passthrough to proper override known types
agentgateway/websiteagentgateway/agentgateway#4188 — llm: apply transformations to path based providers
agentgateway/websitecrates/agentgateway/src/proxy/httpproxy.rsRelease notes
This pull request also adds its release-note entries:
content/docs/kubernetes/main/release-notes/release-notes.md: LLM model transformations now apply to path-based provider requests (breaking_change, in a new 1.8 section)content/docs/standalone/main/release-notes/release-notes.md: LLM model transformations now apply to path-based provider requests (breaking_change, in a new 1.8 section)Draft branch:
pr-tracker-draft-agentgateway-4185-plus1