How to Use the ConverseStream API on AWS

Select Language:

If you are looking to use the ConverseStream API in Amazon Bedrock, you’ll be pleased to know that it supports more than just the Anthropic Claude models. According to the official documentation, Amazon Titan models also work with the ConverseStream API, giving you flexibility in your projects.

The API supports a range of Amazon Bedrock models with streaming features, including:

– Amazon Titan models (which support both Converse and ConverseStream)
– Anthropic Claude 2.x and earlier versions
– Anthropic Claude 3 models
– Anthropic Claude 3.5 Sonnet and Sonnet v2
– Anthropic Claude 3.7 Sonnet
– Anthropic Claude 3.5 Haiku

This means you can confidently use the ConverseStream API with the Amazon Titan Text Express Large Language Model (LLM). The API offers a consistent way to interact with these models, allowing you to write your code once and then switch between different models easily.

However, keep in mind that although the API is available for these models, certain features might differ. For example, Amazon Titan models support document chat (except Titan Text Premier), but they do not support system prompts, vision capabilities, or tool use. Features can vary from one model to another, so it’s good to review the specific capabilities of the model you’re using.

To learn more, you can visit the Amazon Bedrock documentation on supported models and features, as well as the API reference for ConverseStream. These resources will help you get a better understanding of what each model can do and how to integrate the API into your projects efficiently.