Skip to content

[Presets] Update system_prompt for router usage - #4294

Draft
Bihan wants to merge 1 commit into
dstackai:masterfrom
Bihan:update_system_prompt_for_router_usage
Draft

Bihan wants to merge 1 commit into
dstackai:masterfrom
Bihan:update_system_prompt_for_router_usage

Conversation

@Bihan

@Bihan Bihan commented Sep 16, 2026

Copy link
Copy Markdown
Collaborator

Previously, presets only used a separate router for PD disaggregation. Now, whenever a fleet has placement: cluster and a CPU-only instance, presets host an SMG router on that instance and run every trial and the final service behind it, with workers connected over gRPC.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant