docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B and MiniCPM5-1B (iPhone / iPad / Mac) - #369
Open
john-rocky wants to merge 2 commits into
Open
docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B and MiniCPM5-1B (iPhone / iPad / Mac)#369john-rocky wants to merge 2 commits into
john-rocky wants to merge 2 commits into
Conversation
Adds docs/deployment/coreai.md and skills/minicpm5-deploy-coreai/SKILL.md (community Core AI .aimodel conversion of MiniCPM5-2B, iPhone / iPad / Mac in Swift), routes "iPhone / iOS / Swift / Xcode" to the new skill in minicpm5-deploy, and lists the backend in the MiniCPM5-2B deployment table of README.md and README-cn.md.
john-rocky
force-pushed
the
docs-apple-core-ai
branch
from
September 9, 2026 09:46
d0b5e21 to
8bce5b5
Compare
…router The cookbook and skill now cover both sizes. README.md / README-cn.md get a Core AI row in the MiniCPM5-1B deployment table (8 backends) and `coreai` in the router's route list. The 1B bundle is the per-block-32 rebuild (revision b8a6ac39…); the earlier per-channel bundle did not stop at the end of a turn.
Author
|
Added MiniCPM5-1B in a second commit (cookbook, skill, router, README rows), as the description promised. The earlier 1B bundle's stop problem was on my side and is fixed; the description has the details. Title and description updated to cover both sizes. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Thanks for the per-backend cookbooks and Agent Skills. This adds Apple Core AI as a deployment route, in the shape the table uses: a cookbook and a paired skill, so "run it in an iPhone / iPad / Mac app" has a row in
minicpm5-deploy.What it adds:
docs/deployment/coreai.mdandskills/minicpm5-deploy-coreai/SKILL.md: the Swift path through the community CoreAIKit package, Apple's ownCoreAILanguageModelspath, the conversion recipe, on-device numbers, and pitfalls. Both sizes.minicpm5-deploy: one checkpoint row, one decision-matrix row, one default pick, one line on the sanity check.coreaiin the router's route list.The bundles are community int8 conversions (per-block-32 scales; 2B 2.7 GB, 1B 1.1 GB). Measured: 2B 22.4 tok/s decode on iPhone 17 Pro and 127.6 on M4 Max; 1B 61.7 and 246.6. Both answer
1+1=?and stop, on CoreAIKit and on Apple'sllm-runner.The 1B is the second commit. Its earlier bundle did not stop at the end of a turn; the cause was on my side (a per-channel int8 export whose LM head lost every vocab id above ~65024,
<|im_end|>included). The bundle was rebuilt with per-block-32 scales, the stop is now part of the zoo's gate, and the cookbook names the revision to use.If any wording or placement should be different for this repo, tell me and I will change it.