Skip to content

Adding amazon-bedrock-guardrailConfig for Guardrails to support different streaming types  #52

@supreetkt

Description

@supreetkt

Guardrails supports Asynchronous and Synchronous streaming that determine how guardrails are applied to the model response. This feature is currently not supported by the Bedrock classes. Feature is highlighted here in the Bedrock documentation and requires amazon-bedrock-guardrailConfig to be passed in the API call while using streaming and using InvokeModelWithResponseStream.

boto3 supports this in the invoke_model_with_response_stream method as a part of the body.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions