Skip to content

Commit 3ec356b

Browse files
Sma1lboywsxiaoyszwpaper
authoredJan 15, 2025··
docs(fireworks): adding fireworks HTTP Api example (#3676)
* docs(fireworks): add documentation for Fireworks API models and usage * docs(fireworks): update description for Fireworks API to clarify model inference and deployment services * Update website/docs/references/models-http-api/fireworks.md Co-authored-by: Meng Zhang <meng@tabbyml.com> * Update website/docs/references/models-http-api/fireworks.md * docs(fireworks): update embeddings model description to clarify API support * docs(fireworks): clarify Tabby's support for Fireworks embedding model APIs * doc(models): add deepseek v3 and coder to fireworks --------- Co-authored-by: Meng Zhang <meng@tabbyml.com> Co-authored-by: Wei Zhang <kweizh@tabbyml.com>
1 parent cbdc98d commit 3ec356b

File tree

1 file changed

+27
-0
lines changed

1 file changed

+27
-0
lines changed
 
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
# Fireworks
2+
3+
[Fireworks](https://app.fireworks.ai/) is a cloud platform that offers efficient model inference and deployment services,
4+
providing cost-effective access to a variety of AI models through their API service,
5+
including [Llama 2](https://fireworks.ai/models/fireworks/llama-v2-70b-chat),
6+
[DeepSeek V3](https://fireworks.ai/models/fireworks/deepseek-v3),
7+
[DeepSeek Coder](https://fireworks.ai/models/fireworks/deepseek-coder-v2-instruct) and other open-source models.
8+
9+
## Chat model
10+
11+
Fireworks provides an OpenAI-compatible chat API interface.
12+
13+
```toml title="~/.tabby/config.toml"
14+
[model.chat.http]
15+
kind = "openai/chat"
16+
model_name = "accounts/fireworks/models/deepseek-v3"
17+
api_endpoint = "https://api.fireworks.ai/inference/v1"
18+
api_key = "your-api-key"
19+
```
20+
21+
## Completion model
22+
23+
Fireworks does not offer completion models (FIM) through their API.
24+
25+
## Embeddings model
26+
27+
While Fireworks provides embedding model APIs, Tabby has not yet implemented a compatible client to interface with these APIs. Therefore, embedding functionality is currently not available through Tabby's integration with Fireworks.

0 commit comments

Comments
 (0)
Please sign in to comment.