Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

172 Open 1,759 Closed
172 Open 1,759 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

No module named 'deep_gemm' gpu
#3249 opened Apr 14, 2025 by lordk911
3 tasks
v1.x
vllm开启gemma-3-27b模型response_format报错
#3247 opened Apr 14, 2025 by Cloud-LoneCrane
1 of 3 tasks
v1.x
1
分布式部署时，在UI上Running Models的Address只能看到一个worker的地址 gpu
#3246 opened Apr 14, 2025 by 80ca86
1 of 3 tasks
v1.x
1
[NEW MODEL][LLM]Skywork-OR1 feature new model
#3244 opened Apr 13, 2025 by Minamiyama v1.x
[NEW MODEL][VL]Skywork-R1V feature new model
#3243 opened Apr 13, 2025 by Minamiyama v1.x
执行gemma-3-12b q3-k-l的时候报错
#3240 opened Apr 13, 2025 by lakako
1 of 3 tasks
v1.x
1
Add support for KTransformers feature gpu
#3239 opened Apr 13, 2025 by yeungtuzi v1.x
1
Invalid model uri when register model gpu
#3238 opened Apr 12, 2025 by usegitforwhat
1 of 3 tasks
v1.x
1
当推理参数异常时,修改后再次启动报错 gpu
#3237 opened Apr 12, 2025 by qlanto224
1 of 3 tasks
v1.x
1
XINFERENCE Data cannot be persisted gpu
#3231 opened Apr 11, 2025 by freemankevin
1 of 3 tasks
v1.x
4
报错[xinference] Server Unavailable Error, Failed to rerank documents, detail: [address=192.168.1.29:57290, pid=11640] Error when sending message
#3229 opened Apr 11, 2025 by Hiroshi230
1 of 3 tasks
v1.x
1
离线下载的Qwen/Qwen2.5-VL-7B-Instruct 启动失败
#3227 opened Apr 11, 2025 by niubiqianshui
1 of 3 tasks
v1.x
1
[EMB][multimodal]gme-qwen2-vl feature new model
#3226 opened Apr 10, 2025 by Minamiyama v1.x
[NEW MODEL][TTS]bilibili IndexTTS feature new model
#3225 opened Apr 10, 2025 by Minamiyama v1.x
1
docker启动失败,进入容器提示Illegal instruction (core dumped) gpu
#3223 opened Apr 10, 2025 by qlanto224
1 of 3 tasks
v1.x
5
两张4090卡上部署rerank模型，无法并行计算
#3222 opened Apr 10, 2025 by yidasanqian v1.x
8
加载CosyVoice模型失败
#3221 opened Apr 10, 2025 by XUANYUANRuins
1 of 3 tasks
v1.x
[NEW MODEL][VL]Kimi-VL feature new model
#3220 opened Apr 10, 2025 by Minamiyama v1.x
@Jun-Howie
QwQ-32B无法看到推理链 gpu
#3219 opened Apr 10, 2025 by flyrun9527
1 of 3 tasks
v1.x
3
SGLang运行的大模型无法接受长文本输入，无法使用MaxKB知识库系统，Keyerror: 'text' gpu
#3218 opened Apr 9, 2025 by frankSARU
1 of 3 tasks
v1.x
8
QwQ-32B模型在接收超过5W字后会输出乱码 gpu
#3215 opened Apr 9, 2025 by IcarusLove520
1 of 3 tasks
v1.x
1
使用docker镜像，SGLang引擎部署模型时，镜像内缺少nvcc gpu
#3214 opened Apr 9, 2025 by frankSARU
1 of 3 tasks
v1.x
1
RuntimeError: Encoder not found for codec: mp3
#3211 opened Apr 9, 2025 by javaylh
1 of 3 tasks
v1.x
3
安装 CosyVoice2-0.5B 报错提示[Errno 2] No such file or directory: '/home/tank/xinference/cache/CosyVoice2-0.5B/cosyvoice.yaml gpu
#3208 opened Apr 9, 2025 by zhangguohan
1 of 3 tasks
v1.x
5
请求添加jina-reranker-m0支持 feature
#3206 opened Apr 9, 2025 by Oaklight v1.x
1
2
ProTip! Follow long discussions with comments:>50.