{"observation":{"id":"ed66c473-a880-4d06-8d75-0990ec076849","tool":"scenario","tool_name":"Scenario","criterion":"identity-preservation","criterion_name":"Identity preservation","criterion_definition":"How closely the generated face matches the reference image across scenes.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"This is the core of the task: the tool must keep the same character looking like the reference image across scenes. (3 of 3 judges)","scenario":"full-frontal-portrait","scenario_name":"Full frontal portrait","group_tag":null,"scenario_description":"Full frontal portrait reference image with fair skin, curly dark hair, bindi, gold jhumka earrings, and a green stone necklace. All features are clearly visible in good natural lighting, making it the easiest identity anchor for the tools.","modality":"image","input_text":null,"input_artifact_refs":[],"stresses":["Baseline identity preservation","Accessory retention","Best-case frontal face matching","Consistent character reuse across varied scenes"],"verdict":"worked","score":null,"score_total":null,"note":"The tool can keep a subject recognisably the same person in an action scene, with face shape, eyes, and overall look staying close to the reference.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/scenario-scenario-input1-horseride-d01d0d9cfea4.png","role":"output","alt":null}],"run_id":"1dfb8fa4-f7f0-47dc-911b-7db3af467e9a","study_title":"Generate Consistent AI Characters Across Different Scenes and Poses","study_kind":"generation","research_task":"86b96df11","tested_at":null,"completeness":"output-only","input":{"state":"not-captured","text":null,"files":[],"modality":"image","stresses":["Baseline identity preservation","Accessory retention","Best-case frontal face matching","Consistent character reuse across varied scenes"]},"tool_page_slug":"scenario","tool_url":"https://aidemos.com/tools/scenario","permalink":"https://aidemos.com/evidence/ed66c473-a880-4d06-8d75-0990ec076849","api_url":"https://ai.aidemos.com/v1/observations/ed66c473-a880-4d06-8d75-0990ec076849"},"peers":[{"id":"b461a3a8-6c06-4646-aed7-678dd35f3fa1","tool":"chatgpt","tool_name":"ChatGPT","verdict":"worked","score":null,"score_total":null,"note":"Keeps facial structure close to the reference in a frontal composition and is described as the best output from this input, with identity held strongly overall.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/chatgpt-chatgpt-input1-interrogation-ac70251ebac4.png","evidence_url":"https://aidemos.com/evidence/b461a3a8-6c06-4646-aed7-678dd35f3fa1"},{"id":"dca3c251-2404-443c-b298-4ef168e9c42c","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"The plain interrogation setup is the best identity anchor for this input, keeping the eyes, face shape, nose, and overall facial structure close to the reference.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-input-1-abf743cbaaf0.png","evidence_url":"https://aidemos.com/evidence/dca3c251-2404-443c-b298-4ef168e9c42c"},{"id":"a9483897-1a64-47e5-ac48-2e943f7a2286","tool":"imagineart","tool_name":"ImagineArt","verdict":"struggled","score":null,"score_total":null,"note":"The desert-horse output shows clear identity drift, with the eye shape, nose structure, jawline, and face proportions all differing from the reference.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/imagineart-input-1-561e7b836cdd.png","evidence_url":"https://aidemos.com/evidence/a9483897-1a64-47e5-ac48-2e943f7a2286"},{"id":"4e0e50d8-26b7-4be3-b152-52549b890e61","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"It can keep a frontal character recognisable in a new scene, but the face is refined enough that the match is only moderate.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/leonardo-ai-input-1-5e817fd0f4a6.png","evidence_url":"https://aidemos.com/evidence/4e0e50d8-26b7-4be3-b152-52549b890e61"}],"other_criteria":[{"id":"6a1796e6-76aa-4a88-84d2-ba870e97737e","criterion":"expression-accuracy","criterion_name":"Expression accuracy","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"It fails to map an angry or guarded prompt onto the face; the output stays neutral or calm and even reads with a slight smile.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/6a1796e6-76aa-4a88-84d2-ba870e97737e"},{"id":"bc2d761a-8541-43ff-83a0-014ce45ad8d2","criterion":"scene-compliance","criterion_name":"Scene compliance","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"It can reproduce the interrogation-room setup and wardrobe, but the requested harsh mood is softened because the lighting and facial affect stay gentle.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/bc2d761a-8541-43ff-83a0-014ce45ad8d2"}],"appears_in":[{"page_type":"ranking","slug":"consistent-ai-characters","title":"Best AI Tools for Consistent AI Characters Across Scenes and Poses","url":"https://aidemos.com/best/consistent-ai-characters","binding":"run"}],"same_scenario":[{"id":"b461a3a8-6c06-4646-aed7-678dd35f3fa1","tool":"chatgpt","tool_name":"ChatGPT","verdict":"worked","score":null,"score_total":null,"note":"Keeps facial structure close to the reference in a frontal composition and is described as the best output from this input, with identity held strongly overall."},{"id":"dca3c251-2404-443c-b298-4ef168e9c42c","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"The plain interrogation setup is the best identity anchor for this input, keeping the eyes, face shape, nose, and overall facial structure close to the reference."},{"id":"a9483897-1a64-47e5-ac48-2e943f7a2286","tool":"imagineart","tool_name":"ImagineArt","verdict":"struggled","score":null,"score_total":null,"note":"The desert-horse output shows clear identity drift, with the eye shape, nose structure, jawline, and face proportions all differing from the reference."},{"id":"4e0e50d8-26b7-4be3-b152-52549b890e61","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"It can keep a frontal character recognisable in a new scene, but the face is refined enough that the match is only moderate."}]}