{"observation":{"id":"99d02e39-0b2c-4869-b966-fb655c676bfc","tool":"imagineart","tool_name":"ImagineArt","criterion":"scene-compliance","criterion_name":"Scene compliance","criterion_definition":"How accurately the output follows the prompt — environment, attire, pose, props.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"The ranking is about using the character in varied scenes and poses, so following the requested environment, attire, pose, and props is central to success. (3 of 3 judges)","scenario":"full-frontal-portrait","scenario_name":"Full frontal portrait","group_tag":null,"scenario_description":"Full frontal portrait reference image with fair skin, curly dark hair, bindi, gold jhumka earrings, and a green stone necklace. All features are clearly visible in good natural lighting, making it the easiest identity anchor for the tools.","modality":"image","input_text":null,"input_artifact_refs":[],"stresses":["Baseline identity preservation","Accessory retention","Best-case frontal face matching","Consistent character reuse across varied scenes"],"verdict":"mixed","score":null,"score_total":null,"note":"The interrogation-room output follows the harsh lighting, serious expression, formal clothing, tight back hair, and bindi, but it shows less body than the prompt specified.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/imagineart-imagineart-input1-interrogation-cfe1542ae993.jpg","role":"output","alt":null}],"run_id":"1dfb8fa4-f7f0-47dc-911b-7db3af467e9a","study_title":"Generate Consistent AI Characters Across Different Scenes and Poses","study_kind":"generation","research_task":"86b96df11","tested_at":null,"completeness":"output-only","input":{"state":"not-captured","text":null,"files":[],"modality":"image","stresses":["Baseline identity preservation","Accessory retention","Best-case frontal face matching","Consistent character reuse across varied scenes"]},"tool_page_slug":"imagineart","tool_url":"https://aidemos.com/tools/imagineart","permalink":"https://aidemos.com/evidence/99d02e39-0b2c-4869-b966-fb655c676bfc","api_url":"https://ai.aidemos.com/v1/observations/99d02e39-0b2c-4869-b966-fb655c676bfc"},"peers":[{"id":"bff43a61-6f40-4da2-922d-1c38161337af","tool":"chatgpt","tool_name":"ChatGPT","verdict":"worked","score":null,"score_total":null,"note":"Follows the full-frontal interrogation setup precisely: the navy shirt, hands on the metal table, and plain background are all present as prompted.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/chatgpt-chatgpt-input1-interrogation-ac70251ebac4.png","evidence_url":"https://aidemos.com/evidence/bff43a61-6f40-4da2-922d-1c38161337af"},{"id":"4478b970-4ebb-48c8-9921-315ce84fd9fe","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"The warm cafe prompt is followed strongly, with the cozy cafe setting, warm lighting, background blur, sweater, braided hairstyle, and natural pose all rendered correctly.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-input-1-abf743cbaaf0.png","evidence_url":"https://aidemos.com/evidence/4478b970-4ebb-48c8-9921-315ce84fd9fe"},{"id":"504bb238-1d54-4cff-bc33-9bd9b9bb9b59","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"It can place the subject in a believable interrogation setup with the correct outfit, but the room stays too neat and loses the harsh institutional atmosphere.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/leonardo-ai-leonardo-input1-interrogation-77ba6593d6a0.jpg","evidence_url":"https://aidemos.com/evidence/504bb238-1d54-4cff-bc33-9bd9b9bb9b59"},{"id":"bc2d761a-8541-43ff-83a0-014ce45ad8d2","tool":"scenario","tool_name":"Scenario","verdict":"mixed","score":null,"score_total":null,"note":"It can reproduce the interrogation-room setup and wardrobe, but the requested harsh mood is softened because the lighting and facial affect stay gentle.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/scenario-scenario-input1-interrogation-8a626f0b95c8.png","evidence_url":"https://aidemos.com/evidence/bc2d761a-8541-43ff-83a0-014ce45ad8d2"}],"other_criteria":[{"id":"6650d49c-d987-49c9-861d-9cd900685ae5","criterion":"accessory-and-detail-retention","criterion_name":"Accessory & detail retention","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output retains the bindi and tight back hair correctly, and the report says harsh lighting reveals more skin texture with less over-smoothing than the other Input 1 scenes.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/6650d49c-d987-49c9-861d-9cd900685ae5"},{"id":"68d74788-e0d6-4548-b1b3-483e48229716","criterion":"accessory-and-detail-retention","criterion_name":"Accessory & detail retention","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The warm-cafe output changes a specific facial detail: the eye colour shifts from black in the reference to brown in the output.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/68d74788-e0d6-4548-b1b3-483e48229716"},{"id":"1e1e3fce-4d6f-4c95-9b95-f418b907d759","criterion":"expression-accuracy","criterion_name":"Expression accuracy","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The desert-horse output does not match the prompted intensity and determination; the expression is neutral and composed instead.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/1e1e3fce-4d6f-4c95-9b95-f418b907d759"},{"id":"a463c854-4e75-436e-bef8-df02f6bcfcff","criterion":"expression-accuracy","criterion_name":"Expression accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output matches the requested serious, guarded expression.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a463c854-4e75-436e-bef8-df02f6bcfcff"},{"id":"669f1e69-857a-4f41-88cc-29961c0ee861","criterion":"identity-preservation","criterion_name":"Identity preservation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output is the strongest Input 1 match, with the eyes, nose, lips, and face shape closest to the reference across the Input 1 scenes.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/669f1e69-857a-4f41-88cc-29961c0ee861"},{"id":"a9483897-1a64-47e5-ac48-2e943f7a2286","criterion":"identity-preservation","criterion_name":"Identity preservation","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The desert-horse output shows clear identity drift, with the eye shape, nose structure, jawline, and face proportions all differing from the reference.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/a9483897-1a64-47e5-ac48-2e943f7a2286"},{"id":"e43e297f-c4bf-436b-85b8-14f273cd82dd","criterion":"identity-preservation","criterion_name":"Identity preservation","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The warm-cafe output keeps the subject recognisable but not exact; the report says eye colour shifts from black to brown and facial proportions are slightly altered.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/e43e297f-c4bf-436b-85b8-14f273cd82dd"}],"appears_in":[{"page_type":"ranking","slug":"consistent-ai-characters","title":"Best AI Tools for Consistent AI Characters Across Scenes and Poses","url":"https://aidemos.com/best/consistent-ai-characters","binding":"run"}],"same_scenario":[{"id":"bff43a61-6f40-4da2-922d-1c38161337af","tool":"chatgpt","tool_name":"ChatGPT","verdict":"worked","score":null,"score_total":null,"note":"Follows the full-frontal interrogation setup precisely: the navy shirt, hands on the metal table, and plain background are all present as prompted."},{"id":"4478b970-4ebb-48c8-9921-315ce84fd9fe","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"The warm cafe prompt is followed strongly, with the cozy cafe setting, warm lighting, background blur, sweater, braided hairstyle, and natural pose all rendered correctly."},{"id":"504bb238-1d54-4cff-bc33-9bd9b9bb9b59","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"It can place the subject in a believable interrogation setup with the correct outfit, but the room stays too neat and loses the harsh institutional atmosphere."},{"id":"bc2d761a-8541-43ff-83a0-014ce45ad8d2","tool":"scenario","tool_name":"Scenario","verdict":"mixed","score":null,"score_total":null,"note":"It can reproduce the interrogation-room setup and wardrobe, but the requested harsh mood is softened because the lighting and facial affect stay gentle."}]}