v1.3.0.post1

What's new in 1.3.0.post1 (2025-02-21)

These are the changes in inference v1.3.0.post1.

New features

• FEAT: Support qwen-2.5-instruct-1m by @Jun-Howie in #2841
• FEAT: support deepseek-v3 and deepseek-r1 by @qinxuye in #2864
• FEAT: [UI] additional parameter tip function. by @yiboyasss in #2876
• FEAT: [UI] add featured models filtering function. by @yiboyasss in #2871
• FEAT: [UI] support form parameters and command line conversion. by @yiboyasss in #2850
• FEAT: support distributed inference for sglang by @qinxuye in #2877
• FEAT: [UI] add n_worker parameter for model launch. by @yiboyasss in #2889
• FEAT: InternVL 2.5 by @Minamiyama in #2776
• FEAT: support vllm reasoning content by @amumu96 in #2905

Enhancements

• enh: add gpu utilization info by @amumu96 in #2852
• ENH: Update Kokoro model by @codingl2k1 in #2843
• ENH: cmdline supports --n-worker, add --model-path and make it compatible with --model_path by @qinxuye in #2890
• BLD: update sglang to v0.4.2.post4 and vllm to v0.7.2 by @qinxuye in #2838
• BLD: fix flashinfer installation in dockerfile by @qinxuye in #2844

Bug fixes

• BUG: Fix whisper CI by @codingl2k1 in #2822
• BUG: fix FLUX when a scheduler is specified which is incompatible. by @shuaiqidezhong in #2897
• BUG: [UI] fix the bug of missing hint during model running. by @yiboyasss in #2904
• BUG: Clear dependency by @codingl2k1 in #2910

Tests

• TST: Pin CI transformers<4.49 by @codingl2k1 in #2883
• TST: fix lint error by @amumu96 in #2911

Documentation

• DOC: distributed inference by @qinxuye in #2908

Others

• CHORE: Xavier now supports vLLM >= 0.7.0, drops support for older versions by @ChengjieLi28 in #2886

New Contributors

• @shuaiqidezhong made their first contribution in #2897

Full Changelog: v1.2.2...v1.3.0.post1