Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Crash using Llama on AWS bedrock #894

Closed
drawal1 opened this issue Apr 24, 2024 · 0 comments
Closed

Crash using Llama on AWS bedrock #894

drawal1 opened this issue Apr 24, 2024 · 0 comments

Comments

@drawal1
Copy link
Contributor

drawal1 commented Apr 24, 2024

Crashes with ValueError exception in predict.py - "Required 'max_tokens' or 'max_output_tokens' not specified in settings." if you use Bedrock with llama2 or llama3
@drawal1 drawal1 mentioned this issue Apr 24, 2024
Merged
arnavsinghvi11 added a commit that referenced this issue Jun 19, 2024
@arnavsinghvi11
Merge pull request #843 from drawal1/main
4379ead 
Fixed issue #894 and #858 (aws_models issues)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@arnavsinghvi11 @drawal1