{"observation":{"id":"5ec13c6e-a74e-4f10-abd3-dc5f4dfb070c","tool":"imagineart","tool_name":"ImagineArt","criterion":"identity-preservation","criterion_name":"Identity preservation","criterion_definition":"How closely the generated face matches the reference image across scenes.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"This is the core of the task: the tool must keep the same character looking like the reference image across scenes. (3 of 3 judges)","scenario":"three-quarter-face-portrait","scenario_name":"Three-quarter face portrait","group_tag":null,"scenario_description":"Three-quarter face reference image with medium-dark skin, tight curly hair in an updo, bindi, and a floral dress. The partial angle and softer lighting make it a harder reference than the frontal portrait and are meant to stress identity consistency.","modality":"image","input_text":null,"input_artifact_refs":[],"stresses":["Identity preservation with partial face angle","Hair texture and updo retention","Skin tone fidelity","Reference-image difficulty under softer lighting"],"verdict":"mixed","score":null,"score_total":null,"note":"The market output keeps the subject reasonably close overall, but the report still calls the identity match moderate because the skin tone shifts and other facial details change slightly.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/imagineart-input-2-a3afbe926005.png","role":"input","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/imagineart-imagineart-input2-market-f1c6fd07f2f4.jpg","role":"output","alt":null}],"run_id":"1dfb8fa4-f7f0-47dc-911b-7db3af467e9a","study_title":"Generate Consistent AI Characters Across Different Scenes and Poses","study_kind":"generation","research_task":"86b96df11","tested_at":null,"completeness":"input-and-output","input":{"state":"not-captured","text":null,"files":[],"modality":"image","stresses":["Identity preservation with partial face angle","Hair texture and updo retention","Skin tone fidelity","Reference-image difficulty under softer lighting"]},"tool_page_slug":"imagineart","tool_url":"https://aidemos.com/tools/imagineart","permalink":"https://aidemos.com/evidence/5ec13c6e-a74e-4f10-abd3-dc5f4dfb070c","api_url":"https://ai.aidemos.com/v1/observations/5ec13c6e-a74e-4f10-abd3-dc5f4dfb070c"},"peers":[{"id":"0d13a121-3d00-4ff1-a1f2-e9f788a60b06","tool":"chatgpt","tool_name":"ChatGPT","verdict":"worked","score":null,"score_total":null,"note":"Preserves face shape and structure well in a frontal composition, though the report notes a slight darkening and a marginally wider, rounder face than the reference.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/chatgpt-chatgpt-input2-interrogation-c78a75b73445.png","evidence_url":"https://aidemos.com/evidence/0d13a121-3d00-4ff1-a1f2-e9f788a60b06"},{"id":"384e897c-c4a6-4bc4-a19d-1afddd298650","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"With a 3/4 reference, the interrogation-room output still preserves identity well, keeping face shape, skin tone, curly hair texture, eyebrows, and overall structure close to the input.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-input-2-1c4e066a03c3.png","evidence_url":"https://aidemos.com/evidence/384e897c-c4a6-4bc4-a19d-1afddd298650"},{"id":"5846aa66-eaa9-4e03-ab34-910182cf41f4","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"When the face is turned partly away in a busy scene, the output still feels like the same character but cannot be fully verified.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/leonardo-ai-image-95c2a8e685d7.png","evidence_url":"https://aidemos.com/evidence/5846aa66-eaa9-4e03-ab34-910182cf41f4"},{"id":"6afd9a45-ca4d-4336-9bf1-660ad4e41244","tool":"scenario","tool_name":"Scenario","verdict":"struggled","score":null,"score_total":null,"note":"Identity drifts in a crowded full-body scene, with a narrower jawline and a thinner body making the result read as a similar-looking person rather than the same subject.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/scenario-scenario-input2-market-f1d754c6924c.png","evidence_url":"https://aidemos.com/evidence/6afd9a45-ca4d-4336-9bf1-660ad4e41244"}],"other_criteria":[{"id":"a92e28aa-2d3c-4c18-a0dd-fe683af1dfde","criterion":"accessory-and-detail-retention","criterion_name":"Accessory & detail retention","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The interrogation-room output flattens the dense curly hair substantially and makes the eyebrows look shorter and slightly uneven.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/a92e28aa-2d3c-4c18-a0dd-fe683af1dfde"},{"id":"0c32686e-670a-4740-98f0-c7b63a4fa0dd","criterion":"accessory-and-detail-retention","criterion_name":"Accessory & detail retention","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The market output lightens the skin tone, removes visible skin marks and scars through smoothing, and makes the lips look less full and more evenly coloured.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/0c32686e-670a-4740-98f0-c7b63a4fa0dd"},{"id":"9f6dd6f3-855d-4f0a-9535-a5219634595e","criterion":"expression-accuracy","criterion_name":"Expression accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output preserves the reference expression well.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/9f6dd6f3-855d-4f0a-9535-a5219634595e"},{"id":"a16d1328-7e31-4ecf-ad70-5f32d9129b28","criterion":"scene-compliance","criterion_name":"Scene compliance","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output follows the clothing, lighting, pose, and environment accurately.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a16d1328-7e31-4ecf-ad70-5f32d9129b28"},{"id":"ee4d502e-3819-4940-8013-0e2217e9d1d7","criterion":"scene-compliance","criterion_name":"Scene compliance","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The market output renders the market environment realistically and follows the prompt well.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/ee4d502e-3819-4940-8013-0e2217e9d1d7"}],"appears_in":[{"page_type":"ranking","slug":"consistent-ai-characters","title":"Best AI Tools for Consistent AI Characters Across Scenes and Poses","url":"https://aidemos.com/best/consistent-ai-characters","binding":"run"}],"same_scenario":[{"id":"0d13a121-3d00-4ff1-a1f2-e9f788a60b06","tool":"chatgpt","tool_name":"ChatGPT","verdict":"worked","score":null,"score_total":null,"note":"Preserves face shape and structure well in a frontal composition, though the report notes a slight darkening and a marginally wider, rounder face than the reference."},{"id":"384e897c-c4a6-4bc4-a19d-1afddd298650","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"With a 3/4 reference, the interrogation-room output still preserves identity well, keeping face shape, skin tone, curly hair texture, eyebrows, and overall structure close to the input."},{"id":"5846aa66-eaa9-4e03-ab34-910182cf41f4","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"When the face is turned partly away in a busy scene, the output still feels like the same character but cannot be fully verified."},{"id":"6afd9a45-ca4d-4336-9bf1-660ad4e41244","tool":"scenario","tool_name":"Scenario","verdict":"struggled","score":null,"score_total":null,"note":"Identity drifts in a crowded full-body scene, with a narrower jawline and a thinner body making the result read as a similar-looking person rather than the same subject."}]}