Skip to content

Commit f43d82f

Browse files
Sma1lboyzwpaper
andauthored
docs(amazon-bedrock): add Amazon Bedrock documentation for HTTP API use case (#3693)
* docs: add Amazon Bedrock documentation for API integration and model usage * docs: update Amazon Bedrock documentation to include specific model example * chore: reinstate note advising users to deploy their own API --------- Co-authored-by: Wei Zhang <[email protected]>
1 parent 7305581 commit f43d82f

File tree

1 file changed

+25
-0
lines changed

1 file changed

+25
-0
lines changed
+25
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
# Amazon Bedrock
2+
3+
Amazon Bedrock is a fully managed service on AWS that provides access to foundation models from various AI companies through a single API. With [Amazon Bedrock Access Gateway](https://github.com/aws-samples/bedrock-access-gateway), you can access Anthropic's Claude models through an OpenAI-compatible interface, enabling seamless integration with tools and applications designed for OpenAI's API structure.
4+
5+
Follow the Amazon Bedrock Access Gateway setup guide to deploy your own OpenAI-compatible API endpoint for Claude models.
6+
7+
## Chat model
8+
9+
Amazon Bedrock Access Gateway provides an OpenAI-compatible chat API interface for Claude models. Here we use the `us.anthropic.claude-3-5-sonnet-20241022-v2:0` model as an example.
10+
11+
```toml title="~/.tabby/config.toml"
12+
[model.chat.http]
13+
kind = "openai/chat"
14+
model_name = "us.anthropic.claude-3-5-sonnet-20241022-v2:0"
15+
api_endpoint = "http://Bedrock-Proxy-xxxxx.{Region}.elb.amazonaws.com/api/v1"
16+
api_key = "your-api-key"
17+
```
18+
19+
## Completion model
20+
21+
Amazon Bedrock does not provide completion models.
22+
23+
## Embeddings model
24+
25+
While Amazon Bedrock supports embeddings models, Tabby does not currently support the embeddings API interface for Amazon models.

0 commit comments

Comments
 (0)