Image-generation evaluation cases
Categories:
Each case owns its prompt, supplied reference and review criteria. The operator approved publishing both cases and their assets. Both reference files retain their original operator-supplied bytes.
The thorn case depicts a forbidden burial ground of monumental artificial thorns and one visibly impaled, flesh-covered adult corpse. Its reference guides architectural form; the text directs a low viewpoint, asymmetric silhouettes, selective painterly edges and harsh raking light. The architecture dominates, while a legible chest wound, dead face and hanging posture provide a shocking second reading. Emotional intensity has its own review criterion; darkness and detail alone do not establish it. A skeleton or bare skull fails subject adherence. Compare text-only and reference-guided results with the same seeds.
The plush case requests visible petting motion and a seamless loop. Frame prompts describe successive static hand poses, with identical first and last poses. Its edit_region selects the hand area for masked comparisons. The matrix compares chained feedback, original-reference sampling and native Qwen editing; it does not imply a trained video model or guarantee smooth motion. Its sketch comparison provides a corrected structural input and a staged sketch-only/appearance-reference procedure. This separate diagnostic does not run as part of the existing GIF matrix.
Execution, media validity, timings and cleanup can be checked automatically. Review requested subject, style, reference adherence and artistic quality separately on a 0–4 scale: absent, weak, partial, mostly achieved, consistently achieved. Leave unreviewed scores null. Valid files are not quality acceptance.
Deployment configuration and credentials belong to infra/image_gen/evals. Generated outputs and reports belong to the configured ignored output directory.