Skip to content

Add operator benchmark utility scripts - #46

Closed
baominghelly wants to merge 1 commit into
masterfrom
agent/operator-benchmark-scripts
Closed

Add operator benchmark utility scripts#46
baominghelly wants to merge 1 commit into
masterfrom
agent/operator-benchmark-scripts

Conversation

@baominghelly

Copy link
Copy Markdown
Collaborator

Summary

  • add a CLI for generating deterministic operator benchmark inputs
  • add a CLI for aggregating operator result JSON files
  • document both workflows in scripts/README.md
  • add focused tests for configuration generation, shape derivation, CLI validation, and aggregation

Why

The utility scripts are useful independently of the InfiniOps adapter implementation and made the adapter pull request unnecessarily large. Keeping them in a separate pull request gives the generator and reporting formats a focused review surface.

The generator also now emits linear weights as [K, N], matching the InfiniOps matrix contract and the generated [M, N] output.

Validation

  • python3 -m pytest -q tests/test_operator_scripts.py: 6 passed
  • Black 23.9.1 check: passed
  • Flake8 7.3.0 check: passed
  • Cambricon generator dry run for linear/mm/add: passed
  • Aggregator CLI smoke test over 12 real MLU result files: passed

This PR is intentionally independent of the InfiniOps adapter PR and targets master directly.

Copy link
Copy Markdown
Collaborator Author

GitHub automatically closed this PR when its head branch was renamed to feat/operator-benchmark-scripts. Review continues in draft PR #48 with the same commit SHA and diff.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant