Add end-to-end sampling controls to the LLM server worker protocol - #21561
Add end-to-end sampling controls to the LLM server worker protocol#21561metascroy wants to merge 1 commit into
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21561
Note: Links to docs will display an error until the docs builds have been completed. ❗ 1 Active SEVsThere are 1 currently active SEVs. If your PR is affected, please view them below: ❌ 1 New Failure, 17 PendingAs of commit d91c02e with merge base 4b4df96 ( NEW FAILURE - The following job has failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
@claude review this code |
This PR needs a
|
Summary
Add end-to-end sampling controls to the LLM server worker protocol.
top_p,top_k, andseedfrom chat completion requests through the Python runtime and JSONL worker protocol.Test Plan
top_pandtop_k.