How to Fix AWS Bedrock Chat Playground ThrottlingException

Select Language:

If you’re facing a “ThrottlingException” error on Amazon Bedrock with the message “Too many tokens per day, please wait before trying again,” even when you’re only using it a little, you’re not alone. Many users have recently experienced this strange issue, and it may not be due to your actual usage. Sometimes, the limits set for certain regions or specific models are mistakenly set very low or even to zero, which causes these errors.

Here’s what you can do to fix the problem:

First, try switching to a different region. Some users found that changing from one region, like us-east-1, to another, such as us-west-2, can help because resources may be more available there.

Next, see if cross-region inference is an option for your setup, which might improve your experience.

If these steps don’t help, it’s a good idea to reach out to AWS support. Even if you don’t have a paid support plan, you can still contact them through general or billing support channels. When you contact them, explain that you’re getting throttling errors even though your usage is minimal and your quotas appear to be set higher than zero.

Lastly, check your current quotas in the AWS Management Console. Make sure the limits for your Amazon Bedrock usage are correctly set and haven’t been reduced unintentionally.

AWS support can investigate and adjust your quotas if needed. Keep in mind, it may take around 48 hours for them to resolve the issue. Rest assured, this isn’t a normal part of Bedrock’s operation and should only be temporary.

This approach should help you get back to using Amazon Bedrock smoothly again.