Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Run tabby in one minute" don't work #3973

Closed
componhead opened this issue Mar 10, 2025 · 2 comments
Closed

"Run tabby in one minute" don't work #3973

componhead opened this issue Mar 10, 2025 · 2 comments

Comments

@componhead
Copy link

componhead commented Mar 10, 2025

In my system, when I run

docker run -it \
  --gpus all -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby \
  serve --model StarCoder-1B --device cuda --chat-model Qwen2-1.5B-Instruct

I have the following message:
docker: no matching manifest for linux/arm64/v8 in the manifest list entries.

tech stack:
Docker version 27.5.1, build 9f9e405

Software:

    System Software Overview:

      System Version: macOS 15.3.1 (24D70)
      Kernel Version: Darwin 24.3.0
      Boot Volume: Macintosh HD
      Boot Mode: Normal
      Secure Virtual Memory: Enabled
      System Integrity Protection: Enabled

Hardware:

    Hardware Overview:

      Model Name: MacBook Pro
      Model Identifier: MacBookPro18,1
      Chip: Apple M1 Pro
      Total Number of Cores: 10 (8 performance and 2 efficiency)
      Memory: 16 GB
      System Firmware Version: 11881.81.4
      OS Loader Version: 11881.81.4
      Activation Lock Status: Enabled

Any idea?

P.S.
tabby server works well in browser (not containerized) instead (except for vim autocompletion, another issue)

@zwpaper
Copy link
Member

zwpaper commented Mar 10, 2025

Hi @componhead, The quick-start command for Docker defaults to utilizing an NVIDIA GPU.

Since you are using macOS, please follow the macOS installation guide for Tabby at https://tabby.tabbyml.com/docs/quick-start/installation/apple/. Once installed, we can investigate the vim autocompletion if the issue persists.

@componhead
Copy link
Author

componhead commented Mar 10, 2025

Ok, thank you. I misunderstood.
Tabby via browser works well (already installed via your link), the autocompletion stops working a few weeks ago. I opened an issue to vim-tabby

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants