Skip to content

[Klaud Cold] kimik2.5-fp4-b300-vllm: v0.26.0 image, extend conc to 512, add DEP4 arm / 升级 B300 镜像至 v0.26.0,扩展并发,新增 DEP4 - #2442

Closed
xinli-sw wants to merge 1 commit into
mainfrom
feat/kimik2.5-fp4-b300-vllm-v0.26.0
Closed

[Klaud Cold] kimik2.5-fp4-b300-vllm: v0.26.0 image, extend conc to 512, add DEP4 arm / 升级 B300 镜像至 v0.26.0,扩展并发,新增 DEP4#2442
xinli-sw wants to merge 1 commit into
mainfrom
feat/kimik2.5-fp4-b300-vllm-v0.26.0

Conversation

@xinli-sw

@xinli-sw xinli-sw commented Aug 1, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Image: v0.22.0vllm/vllm-openai:v0.26.0
  • TP arms: TP8 and TP4 extended to conc-end: 512
  • New DEP4 arm: tp: 4, ep: 4, dp-attn: true, conc-start: 128, conc-end: 512
  • Bench script (kimik2.5_fp4_b200.sh): DP_ATTENTION handling added — switches to --data-parallel-size, adds --enable-expert-parallel and --prefill-schedule-interval 4 in DEP4 mode

中文说明

  • 镜像v0.22.0vllm/vllm-openai:v0.26.0
  • TP 配置:TP8 和 TP4 并发上限均扩展至 conc-end: 512
  • 新增 DEP4 配置tp: 4, ep: 4, dp-attn: true, conc-start: 128, conc-end: 512
  • 基准脚本kimik2.5_fp4_b200.sh):新增 DP_ATTENTION 处理逻辑,DEP4 模式下切换为 --data-parallel-size,并启用 --enable-expert-parallel--prefill-schedule-interval 4

@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor

Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase As a PR reviewer and CODEOWNER, I have reviewed this and have.

For PR verification, add the full-sweep-fail-fast label (strongly recommended) to this PR — the benchmark sweep only runs on labeled PRs. Use full-sweep-enabled only if you need matrix jobs to keep running past a failure.

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs


感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 As a PR reviewer and CODEOWNER, I have reviewed this and have

如需进行 PR 验证,请为此 PR 添加 full-sweep-fail-fast 标签(强烈推荐)— 基准测试 sweep 仅在带有标签的 PR 上运行。仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled

PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档

@xinli-sw xinli-sw changed the title [Klaud Cold] kimik2.5-fp4-b200-vllm: v0.26.0 image, extend conc to 512, add DEP4 arm / 升级 B200 镜像至 v0.26.0,扩展并发,新增 DEP4 [Klaud Cold] kimik2.5-fp4-b300-vllm: v0.26.0 image, extend conc to 512, add DEP4 arm / 升级 B300 镜像至 v0.26.0,扩展并发,新增 DEP4 Aug 1, 2026
Comment thread perf-changelog.yaml Outdated
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw
xinli-sw force-pushed the feat/kimik2.5-fp4-b300-vllm-v0.26.0 branch from c3cace5 to bfc24ba Compare August 2, 2026 20:59
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw
xinli-sw force-pushed the feat/kimik2.5-fp4-b300-vllm-v0.26.0 branch from 749e714 to cbe1cf2 Compare August 2, 2026 21:06
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw
xinli-sw force-pushed the feat/kimik2.5-fp4-b300-vllm-v0.26.0 branch from d5a6cf1 to 50753a8 Compare August 2, 2026 21:33
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw
xinli-sw force-pushed the feat/kimik2.5-fp4-b300-vllm-v0.26.0 branch 2 times, most recently from 58cb5cd to 22f4d7f Compare August 2, 2026 21:40
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw
xinli-sw force-pushed the feat/kimik2.5-fp4-b300-vllm-v0.26.0 branch from fbbdf4a to 80d9ed8 Compare August 3, 2026 04:43
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw
xinli-sw force-pushed the feat/kimik2.5-fp4-b300-vllm-v0.26.0 branch 2 times, most recently from e1b0ff9 to b13329c Compare August 3, 2026 07:29
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions Bot Aug 7, 2026
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

@xinli-sw

xinli-sw commented Aug 7, 2026

Copy link
Copy Markdown
Collaborator Author

Reopening under new branch name.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

1 participant