Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Nov 3, 2025

Bumps azure-ai-evaluation from 1.8.0 to 1.13.0.

Release notes

Sourced from azure-ai-evaluation's releases.

azure-ai-evaluation_1.13.0

1.13.0 (2025-10-30)

Features Added

  • Updated IndirectAttack risk category for RedTeam to IndirectJailbreak to better reflect its purpose. This change allows users to apply cross-domain prompt injection (XPIA) attack strategies across all risk categories, enabling more comprehensive security testing of AI systems against indirect prompt injection attacks during red teaming.

  • Added TaskAdherence, SensitiveDataLeakage, and ProhibitedActions as cloud-only agent safety risk categories for red teaming.

  • Updated all evaluators' output to be of the following schema:

    • gpt_{evaluator_name}, {evaluator_name}: float score,
    • {evaluator_name}_result: pass/fail based on threshold,
    • {evaluator_name}_reason, {evaluator_name}_threshold
    • {evaluator_name}_prompt_tokens, {evaluator_name}_completion_tokens, {evaluator_name}_total_tokens, {evaluator_name}_finish_reason
    • {evaluator_name}_model: model used for evaluation
    • {evaluator_name}_sample_input, {evaluator_name}_sample_output: input and output used for evaluation

    This change standardizes the output format across all evaluators and follows OTel convention.

Bugs Fixed

  • image_tag parameter in AzureOpenAIPythonGrader is now optional.

azure-ai-evaluation_1.12.0

1.12.0 (2025-10-02)

Features Added

  • AOAI Graders now accept a "credential" parameter that can be used for authentication with an AzureOpenAIModelConfiguration
  • Added is_reasoning_model parameter support to CoherenceEvaluator, FluencyEvaluator, SimilarityEvaluator, GroundednessEvaluator, RetrievalEvaluator, and RelevanceEvaluator to enable reasoning model configuration for o1/o3 models.

Bugs Fixed

  • Support for multi-level nesting in OpenAI grader (experimental)

azure-ai-evaluation_1.11.2

1.11.2 (2025-10-09)

Bugs Fixed

  • **kwargs in an evaluator signature receives input columns that are not otherwise named in the evaluator's signature

azure-ai-evaluation_1.11.1

1.11.1 (2025-09-17)

Bugs Fixed

  • Pinning duckdb version to 1.3.2 for redteam extra to fix error TypeError: unhashable type: '_duckdb.typing.DuckDBPyType'
Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [azure-ai-evaluation](https://github.com/Azure/azure-sdk-for-python) from 1.8.0 to 1.13.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-python/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-python/blob/main/doc/esrp_release.md)
- [Commits](Azure/azure-sdk-for-python@azure-ai-evaluation_1.8.0...azure-ai-evaluation_1.13.0)

---
updated-dependencies:
- dependency-name: azure-ai-evaluation
  dependency-version: 1.13.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Nov 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update Python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant