| layout | name | description | authors | pypi | repo | type | report_issue | logo | version | toc | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
integration |
Amazon Bedrock |
Use Models from AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via Amazon Bedrock with Haystack |
|
Model Provider |
/logos/aws.png |
Haystack 2.0 |
true |
Amazon Bedrock is a fully managed service that makes high-performing foundation models from leading AI startups and Amazon available for your use through a unified API. You can choose from various foundation models to find the one best suited for your use case. More information can be found on the documentation page.
Install the Amazon Bedrock integration:
pip install amazon-bedrock-haystackOnce installed, you will have access to an AmazonBedrockGenerator that supports models from various providers:
- Anthropic's Claude
- AI21 Labs' Jurassic-2
- Stability AI's Stable Diffusion
- Cohere's Command and Embed
- Meta's Llama 2
- Amazon Titan language and embeddings models
To use this integration for text generation, initialize a AmazonBedrockGenerator with the model name and aws credentials:
from amazon_bedrock_haystack import AmazonBedrockGenerator
aws_access_key_id="..."
aws_secret_access_key="..."
aws_region_name="eu-central-1"
generator = AmazonBedrockGenerator(model_name="anthropic.claude-v2", aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key, aws_region_name=aws_region_name)
result = generator.run("Who is the best American actor?")
for reply in result["replies"]:
print(reply)Output:
'There is no definitive "best" American actor, as acting skill and talent a# re subjective. However, some of the most acclaimed and influential American act# ors include Tom Hanks, Daniel Day-Lewis, Denzel Washington, Meryl Streep, Rober# t De Niro, Al Pacino, Marlon Brando, Jack Nicholson, Leonardo DiCaprio and John# ny Depp. Choosing a single "best" actor comes down to personal preference.'