Skip to content

[Content Understanding] Update toLlmInput page markers and filter LLMStats telemetry#49396

Draft
chienyuanchang wants to merge 2 commits into
mainfrom
cu-sdk/llm-input-helper-update
Draft

[Content Understanding] Update toLlmInput page markers and filter LLMStats telemetry#49396
chienyuanchang wants to merge 2 commits into
mainfrom
cu-sdk/llm-input-helper-update

Conversation

@chienyuanchang
Copy link
Copy Markdown
Member

Description

Updates the azure-ai-contentunderstanding LlmInputHelper.toLlmInput() helper to align its rendered output with the upcoming service page-marker format and to remove non-user-facing telemetry from RAI warning output.

Changes made:

  • Updated SDK-injected document page markers from <!-- page N --> to <!-- InputPageNumber: N -->.
  • Added duplicate-marker defense: if service markdown already contains <!-- InputPageNumber:, toLlmInput() does not inject additional page markers.
  • Filtered service-emitted internal telemetry warnings whose message starts with LLMStats: from the rendered rai_warnings front matter.
  • Preserved LLMStats: text when it appears in the document markdown body; only structured warnings are filtered.
  • Updated unit tests and sample tests for the new marker format and warning-filter behavior.
  • Updated CHANGELOG.md.

Relevant issues / context:

Companion PRs (sibling SDKs):

This PR is not based on regenerated SDK code from a new swagger / TypeSpec spec.

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
    • No public API signatures are changed. This only changes rendered text produced by the preview LlmInputHelper.toLlmInput() helper.
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message.

Testing Guidelines

  • Pull request includes test coverage for the included changes (31 unit tests pass).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant