diff --git a/docs/INSTALL.md b/docs/INSTALL.md index 1dba25f7..cccd94af 100644 --- a/docs/INSTALL.md +++ b/docs/INSTALL.md @@ -9,6 +9,7 @@ `libnuma-dev` on Debian/Ubuntu) — required for the `core_engine` JIT build (`#include `). `install_deps.sh` installs these automatically; without them the first server launch fails with `numa.h: No such file or directory`. +- **Model-specific (Kimi-K3 / Kimi-linear)**: `fla-core>=0.5.0` (flash-linear-attention) provides the `fla` Kimi-Delta-Attention kernels. It is listed in `requirements.txt`, so `pip install .` (and `install_deps.sh`) pull it automatically — no separate step. - **GitHub access**: the repository is currently **private** — anonymous `git clone` and raw release-asset URLs fail (404). Authenticate first (e.g. `gh auth login`), clone via `gh repo clone batchgen-project/batchgen`, diff --git a/docs/deploy-kimi-k3-h200.md b/docs/deploy-kimi-k3-h200.md index e0ee8a9b..76d435be 100644 --- a/docs/deploy-kimi-k3-h200.md +++ b/docs/deploy-kimi-k3-h200.md @@ -51,6 +51,8 @@ and [Manual Installation](manual-installation.md). The default decode/prefill ex **NCCL**, which needs no extra build. (An optional DeepEP low-latency exchange is covered in §6.) +Kimi-K3's KDA (Kimi Delta Attention) needs `fla-core>=0.5.0` (flash-linear-attention, the `fla` package). It is listed in `requirements.txt`, so the standard install pulls it automatically — no separate step. + ## 4. Start the Server (2 × 8 H200) ### Mount shared memory diff --git a/requirements.txt b/requirements.txt index d951d715..1961bd3f 100644 --- a/requirements.txt +++ b/requirements.txt @@ -13,6 +13,7 @@ dill==0.3.7 einops==0.8.1 fastapi==0.121.1 filelock==3.20.0 +fla-core>=0.5.0 frozenlist==1.8.0 fsspec==2023.10.0 h11==0.16.0