No endpoint found for /docs

[cooktheryan]

System Info

remote-vllm build 0.1.8

Information

• The official example scripts
• My own modified scripts

🐛 Describe the bug

Error keeps posting in logs

Error logs

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 240, in __call__
    _, _, trace_path = find_matching_endpoint(scope.get("method", "GET"), path, self.endpoint_impls)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/endpoints.py", line 128, in find_matching_endpoint
    raise ValueError(f"No endpoint found for {path}")
ValueError: No endpoint found for /docs
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 240, in __call__
    _, _, trace_path = find_matching_endpoint(scope.get("method", "GET"), path, self.endpoint_impls)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/endpoints.py", line 128, in find_matching_endpoint
    raise ValueError(f"No endpoint found for {path}")
ValueError: No endpoint found for /favicon.ico
INFO:     10.128.4.2:49934 - "GET /favicon.ico HTTP/1.1" 400 Bad Request
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 240, in __call__
    _, _, trace_path = find_matching_endpoint(scope.get("method", "GET"), path, self.endpoint_impls)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/endpoints.py", line 128, in find_matching_endpoint
    raise ValueError(f"No endpoint found for {path}")
ValueError: No endpoint found for /favicon.ico
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 240, in __call__
    _, _, trace_path = find_matching_endpoint(scope.get("method", "GET"), path, self.endpoint_impls)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/endpoints.py", line 128, in find_matching_endpoint
    raise ValueError(f"No endpoint found for {path}")
ValueError: No endpoint found for /docs
INFO:     10.128.4.2:60918 - "GET /docs HTTP/1.1" 400 Bad Request
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 240, in __call__
    _, _, trace_path = find_matching_endpoint(scope.get("method", "GET"), path, self.endpoint_impls)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/endpoints.py", line 128, in find_matching_endpoint
    raise ValueError(f"No endpoint found for {path}")
ValueError: No endpoint found for /docs

Expected behavior

no errors in logs

[cooktheryan]

additionally

INFO     2025-03-28 12:15:41,871 __main__:460 server: Listening on ['::', '0.0.0.0']:8321
INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO     2025-03-28 12:15:41,892 __main__:148 server: Starting up
INFO:     Application startup complete.
INFO:     Uvicorn running on http://['::', '0.0.0.0']:8321 (Press CTRL+C to quit)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 240, in __call__
    _, _, trace_path = find_matching_endpoint(scope.get("method", "GET"), path, self.endpoint_impls)
  File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/endpoints.py", line 128, in find_matching_endpoint
    raise ValueError(f"No endpoint found for {path}")
ValueError: No endpoint found for /openapi.json

[solaius]

Submitted PR to fix this issue. Caused by new api routing checks. FastAPI routes were not accounted for.