New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting this backing off problem when I use COPRO #1157

Open

ArslanS1997 opened this issue Jun 15, 2024 · 1 comment

ArslanS1997 commented Jun 15, 2024

Hi no matter which API I use, groq or OpenAI I get this message repeatedly, backing off after x tries

For groq

From OpenAI using gpt 4o

What does this error precisely mean and anyway to mitigate this?

Collaborator

arnavsinghvi11 commented Jun 17, 2024

Hi @ArslanS1997 ,

Try reducing the number of threads so COPRO doesn’t make too many requests simultaneously. This should help avoid triggering the rate limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment