Skip to content

docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B and MiniCPM5-1B (iPhone / iPad / Mac) - #369

Open
john-rocky wants to merge 2 commits into
OpenBMB:mainfrom
john-rocky:docs-apple-core-ai
Open

docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B and MiniCPM5-1B (iPhone / iPad / Mac)#369
john-rocky wants to merge 2 commits into
OpenBMB:mainfrom
john-rocky:docs-apple-core-ai

Conversation

@john-rocky

@john-rocky john-rocky commented Sep 4, 2026

Copy link
Copy Markdown

Thanks for the per-backend cookbooks and Agent Skills. This adds Apple Core AI as a deployment route, in the shape the table uses: a cookbook and a paired skill, so "run it in an iPhone / iPad / Mac app" has a row in minicpm5-deploy.

What it adds:

  • docs/deployment/coreai.md and skills/minicpm5-deploy-coreai/SKILL.md: the Swift path through the community CoreAIKit package, Apple's own CoreAILanguageModels path, the conversion recipe, on-device numbers, and pitfalls. Both sizes.
  • minicpm5-deploy: one checkpoint row, one decision-matrix row, one default pick, one line on the sanity check.
  • README.md / README-cn.md: one row in each deployment table (2B and 1B), and coreai in the router's route list.

The bundles are community int8 conversions (per-block-32 scales; 2B 2.7 GB, 1B 1.1 GB). Measured: 2B 22.4 tok/s decode on iPhone 17 Pro and 127.6 on M4 Max; 1B 61.7 and 246.6. Both answer 1+1=? and stop, on CoreAIKit and on Apple's llm-runner.

The 1B is the second commit. Its earlier bundle did not stop at the end of a turn; the cause was on my side (a per-channel int8 export whose LM head lost every vocab id above ~65024, <|im_end|> included). The bundle was rebuilt with per-block-32 scales, the stop is now part of the zoo's gate, and the cookbook names the revision to use.

If any wording or placement should be different for this repo, tell me and I will change it.

Adds docs/deployment/coreai.md and skills/minicpm5-deploy-coreai/SKILL.md
(community Core AI .aimodel conversion of MiniCPM5-2B, iPhone / iPad / Mac
in Swift), routes "iPhone / iOS / Swift / Xcode" to the new skill in
minicpm5-deploy, and lists the backend in the MiniCPM5-2B deployment table
of README.md and README-cn.md.
@john-rocky john-rocky changed the title docs: add community Apple Core AI conversion of MiniCPM5-1B docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B (iPhone / iPad / Mac) Sep 9, 2026
…router

The cookbook and skill now cover both sizes. README.md / README-cn.md get a Core AI row in the
MiniCPM5-1B deployment table (8 backends) and `coreai` in the router's route list. The 1B bundle
is the per-block-32 rebuild (revision b8a6ac39…); the earlier per-channel bundle did not stop at
the end of a turn.
@john-rocky john-rocky changed the title docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B (iPhone / iPad / Mac) docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B and MiniCPM5-1B (iPhone / iPad / Mac) Sep 9, 2026
@john-rocky

Copy link
Copy Markdown
Author

Added MiniCPM5-1B in a second commit (cookbook, skill, router, README rows), as the description promised. The earlier 1B bundle's stop problem was on my side and is fixed; the description has the details. Title and description updated to cover both sizes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant