Skip to content

Commit 3bd73a8

Browse files
Sma1lboywsxiaoys
andauthored
docs: adding Perplexity AI use case document in tabby-docs (#3678)
* docs(perplexity): add documentation for Perplexity AI models and API usage * chore: Update website/docs/references/models-http-api/perplexity.md Co-authored-by: Meng Zhang <[email protected]> --------- Co-authored-by: Meng Zhang <[email protected]>
1 parent 1be0274 commit 3bd73a8

File tree

1 file changed

+23
-0
lines changed

1 file changed

+23
-0
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
# Perplexity AI
2+
3+
[Perplexity AI](https://www.perplexity.ai/) is a company that develops large language models and offers them through their API service. They currently provide three powerful Llama-based models: [Sonar Small (8B)](https://docs.perplexity.ai/guides/model-cards#supported-models), [Sonar Large (70B)](https://docs.perplexity.ai/guides/model-cards#supported-models), and [Sonar Huge (405B)](https://docs.perplexity.ai/guides/model-cards#supported-models), all supporting a 128k context window.
4+
5+
## Chat model
6+
7+
Perplexity provides an OpenAI-compatible chat API interface. The Sonar Large (70B) and Huge (405B) models are recommended for better performance.
8+
9+
```toml title="~/.tabby/config.toml"
10+
[model.chat.http]
11+
kind = "openai/chat"
12+
model_name = "llama-3.1-sonar-large-128k-online" # Also supports sonar-small-128k-online or sonar-huge-128k-online
13+
api_endpoint = "https://api.perplexity.ai"
14+
api_key = "your-api-key"
15+
```
16+
17+
## Completion model
18+
19+
Perplexity currently does not offer completion-specific API endpoints.
20+
21+
## Embeddings model
22+
23+
Perplexity currently does not offer embeddings models through their API.

0 commit comments

Comments
 (0)