Repository navigation
[Automated] Draft docs (agentgateway): llm: expose request context to response CEL on streaming responses - #1453
Open
github-actions[bot] wants to merge 3 commits into
Open
github-actions[bot] wants to merge 3 commits into
github-actions[bot] wants to merge 3 commits into
Conversation
… response CEL on streaming responses Drafts-Commit: c5dc203 Signed-off-by: GitHub Action <action@github.com>
Deploying agentproxy with
|
| Latest commit: |
3fd39ff
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://f002fab6.agentproxy.pages.dev |
| Branch Preview URL: | https://pr-tracker-draft-agentgatewa-bahi.agentproxy.pages.dev |
The release-notes entry for this change now lives in the combined release-notes PR, #1482, so the draft PRs no longer conflict on the release-notes pages. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Signed-off-by: Kristin Brown <kristin.brown@solo.io>
Collaborator
|
Moved this PR's release-notes entry to the combined release-notes PR, #1482, so the draft PRs stop conflicting on the release-notes pages. Review or change the entry there. |
Signed-off-by: Kristin Brown <kristin.brown@solo.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Rendered output was not compared with the base build: the site does not build at the base commit ed3fb85, so rendering outside the declared versions is unchecked.
agentgateway/agentgateway#4241 — llm: expose request context to response CEL on streaming responses
Docs versions:
standalone/main,kubernetes/mainWhat changes for users: LLM response transformations on streamed responses can read request-side CEL context, including
llm.provider,llm.requestModel, andllm.streaming. Response-derived fields such asllm.responseModelare still unavailable until the stream is parsed.What the docs now say: The standalone transformations and CEL variables pages now state which request-side LLM fields are available for streamed response transformations. The Kubernetes LLM transformations reuse asset now gates the same streamed-response guidance to
mainand says to use those request-side fields instead ofllm.responseModelon streamed response transformations.How
agentgateway-4241was drafted, and what was not verifiedPlan, and what changed it
llm.provider,llm.requestModel, andllm.streaming, whilellm.responseModelis absent.Why a documentation change is necessary
The pull request changes response-side CEL behavior for streamed LLM responses. The Kubernetes transformations page already warned readers away from parsing
response.bodyon streaming routes but directed them tollm.responseModel, which the test in the dossier shows is not available at that point. The standalone transformations and CEL variables pages did not say that request-side LLM fields are available on streamed response transformations, so readers could not safely write these response header transformations.What changed on disk
assets/agw-docs/pages/agentgateway/llm/transformations.md: Gatesmainguidance for streamed response transformations and says to use request-side LLM fields instead ofllm.responseModelon streamed response transformations.content/docs/standalone/main/documentation/configuration/traffic-management/transformations.md: Adds the available request-side LLM fields for streamed response transformations.content/docs/standalone/main/reference/cel/variables.md: Narrows the streaming caveat to distinguish request-side fields from response body and response-derived fields.How to verify this change
process_streaming_exposes_request_llm_context_to_response_celfrom the dossier. The test asserts that response CEL seesllm.provider == "openai",llm.requestModel == "input-model",llm.streaming, and nollm.responseModel.llm_streaming_response_transformation_sees_llm_contextfrom the dossier. The test asserts that a streamed LLM response transformation setsx-llm-provider: openai,x-llm-request-model: replaceme, andx-llm-streaming: true.mainpage must show the gated streamed-response guidance, and older Kubernetes version trees must not show it.Proposed release note
See
proposed-release-note.md.What was not verified
How the pages were chosen (triage report)
Feature clusters
Kept apart on purpose. Merging wrongly produces a guide that documents two things and explains neither, so these are reported for a person to merge rather than grouped automatically:
Draft a documentation change
agentgateway/agentgateway#4241 — llm: expose request context to response CEL on streaming responses
agentgateway/websiteRelease notes
This pull request also adds its release-note entries:
content/docs/standalone/main/release-notes/release-notes.md: llm: expose request context to response CEL on streaming responses (fix, under LLM, in a new 1.8 section)Release notes kept out of a tree. Check that each change really does not reach the trees named here:
kubernetes/main, because the draft edited no page there. If the change also reaches that tree, add the note there.Draft branch:
pr-tracker-draft-agentgateway-4241