An Evaluation Rubric
Score four dimensions separately; a total hides the one that failed
Related
Four threes, and still unusable
Score all four dimensions at three and the total is twelve, which looks tidy. A three for usability means it needs work; a three for editability means the client cannot change it; a three for consistency means the next run will not reproduce it; a three for rights means documents are missing. The total averages four problems into one number, and a single one should veto the version.
The scoring table
| Dimension | 1 | 3 | 5 | What to inspect |
|---|---|---|---|---|
| Usability | Form is loose, unusable as is | Usable after trimming | Ready for post | Sections, intonation, artefacts |
| Editability | Stereo only | Stems, but no MIDI or dry vocal | Stems, MIDI and dry vocal complete | Stem count and start points |
| Consistency | Same prompt, very different results | Broadly stable, occasional drift | Reproducible from the same seed | Seed, version, parameters |
| Rights | Source unclear, documents missing | Mostly complete, open questions remain | Sources and licence files complete | Tool terms, samples, voice consent |
How to keep scores from drifting
Listen blind. Have two raters score independently, then discuss the gaps. Require one sentence of justification per score, tied to a position: "the bass and kick collide in the second chorus". Weight by use: client delivery leans on usability and editability, a library leans on consistency and rights. Keep past scores and re-score a revision without overwriting the earlier record. The numbers are not a ranking; they tell the next revision where to land.
What the rubric should not judge
Novelty, artist fit, audience taste and commercial success are outside these four dimensions. The rights score measures whether files and permissions are complete, not a legal opinion; documents can exist and still leave a scope question that needs separate clearance. The rubric is a sieve that stops versions which clearly cannot be used. What passes still needs a person to listen and decide. Four passing scores mean it earns another round, not that it should be released.
Listen in the library
All tracks from midicn-lib — inline badge is the license tier (C1 commercial / C2 non-commercial / C3 study only).
Along the same line
Sources
- ITU-R BS.1116 与 BS.1534（MUSHRA）关于主观听测与评分量表的设计方法。
- 音频质量与可用性评估的行业实践，来自公开制作与评测资料。
- 生成内容权利尽调清单，来自行业组织与平台公开文件。