Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JWT authentication fails #4047

Closed
nikmit opened this issue Mar 21, 2025 · 2 comments
Closed

JWT authentication fails #4047

nikmit opened this issue Mar 21, 2025 · 2 comments

Comments

@nikmit
Copy link

nikmit commented Mar 21, 2025

Describe the bug
Attempting to use the JWT secret within PyCharm or in the Swagger web interface results in an authentication error

Information about your version
tabby 0.26.0

Information about your GPU

========================================== ROCm System Management Interface ==========================================
==================================================== Concise Info ====================================================
Device  Node  IDs              Temp    Power     Partitions          SCLK    MCLK    Fan  Perf  PwrCap  VRAM%  GPU%  
              (DID,     GUID)  (Edge)  (Socket)  (Mem, Compute, ID)                                                  
======================================================================================================================
0       1     0x687f,   44047  49.0°C  12.0W     N/A, N/A, 0         852Mhz  167Mhz  0%   auto  185.0W  15%    17%   
======================================================================================================================
================================================ End of ROCm SMI Log =================================================

Additional context
Installed from source on linux mint as follows:

apt install rocm-dev libomp-dev
git clone https://github.com/TabbyML/tabby.git
cd tabby/
git submodule update --init --recursive
git tag
git checkout v0.26.0
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
. "$HOME/.cargo/env"
cargo build --release --features rocm
export LD_LIBRARY_PATH=/usr/lib/llvm-18/lib/:$LD_LIBRARY_PATH

After starting with target/release/tabby serve I can access http://localhost:8080/system
I generate a new token, and configure it in ~/.tabby-client/agent/config.toml:

[server]
endpoint = "http://localhost:8080" # http or https URL
token = "3ee2785c-6e23-422e-8dcf-f21ee196c574"

kill the tabby process and start it again

Configure the same token in PyCharm, click Apply, click 'Check connection' -> authentication error
Go to http://localhost:8080/swagger-ui/#/v1/chat_completions

  • Click Authorize and paste the token
  • Try it out -> Execute -> 401 authentication error

At this point I am stuck, hopefully someone can help.

P.S. I will regenerate the token I published above :-)

@wsxiaoys
Copy link
Member

wsxiaoys commented Mar 21, 2025

Hi - You need to acquire token from the place shown in screenshot.

Image

@chx
Copy link

chx commented Apr 5, 2025

You mean you need to click the upper right corner profile icon to get the token.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants