{"observation":{"id":"b1a88b41-148c-4475-a3a7-35f090d1f04c","tool":"chatgpt","tool_name":"ChatGPT","criterion":"scene-compliance","criterion_name":"Scene compliance","criterion_definition":"How accurately the output follows the prompt — environment, attire, pose, props.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"The ranking is about using the character in varied scenes and poses, so following the requested environment, attire, pose, and props is central to success. (3 of 3 judges)","scenario":"near-profile-occluded-portrait-stress-test","scenario_name":"Near-profile occluded portrait stress test","group_tag":null,"scenario_description":"Near-profile portrait reference used as the maximum-difficulty stress test: face turned roughly 80–90 degrees, one eye partially occluded by fringe, short dark wavy hair, and natural outdoor lighting. Designed to probe whether tools can preserve identity under severe pose and occlusion.","modality":"image","input_text":null,"input_artifact_refs":[],"stresses":["Near-profile identity preservation","Occlusion handling","Extreme pose consistency","Lighting and hair-detail retention under stress"],"verdict":"worked","score":null,"score_total":null,"note":"Matches the rooftop prompt well: full-body framing, black turtleneck, beige wide-leg trousers, golden-hour amber lighting, city skyline, and rooftop railing are all present.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/chatgpt-chatgpt-image-jun-9-2026-11-44-28-pm-48266f3c5749.png","role":"output","alt":null}],"run_id":"1dfb8fa4-f7f0-47dc-911b-7db3af467e9a","study_title":"Generate Consistent AI Characters Across Different Scenes and Poses","study_kind":"generation","research_task":"86b96df11","tested_at":null,"completeness":"output-only","input":{"state":"not-captured","text":null,"files":[],"modality":"image","stresses":["Near-profile identity preservation","Occlusion handling","Extreme pose consistency","Lighting and hair-detail retention under stress"]},"tool_page_slug":"chatgpt","tool_url":"https://aidemos.com/tools/chatgpt","permalink":"https://aidemos.com/evidence/b1a88b41-148c-4475-a3a7-35f090d1f04c","api_url":"https://ai.aidemos.com/v1/observations/b1a88b41-148c-4475-a3a7-35f090d1f04c"},"peers":[{"id":"f0e88898-addc-4e27-aaf7-43d6c35286fc","tool":"gemini","tool_name":"Gemini","verdict":"mixed","score":null,"score_total":null,"note":"The rooftop scene is only partially followed: the outfit, rooftop, skyline, and body pose are present, but the face is too frontal, the occlusion stress condition is missed, and the golden-hour lighting shifts cooler and more daytime-like.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-image-c0417a5d4a92.png","evidence_url":"https://aidemos.com/evidence/f0e88898-addc-4e27-aaf7-43d6c35286fc"},{"id":"df36f4b9-1a65-42ca-83d8-146d04d45ab4","tool":"imagineart","tool_name":"ImagineArt","verdict":"struggled","score":null,"score_total":null,"note":"The rooftop output only partially follows the prompt: the sleeve length is wrong, the arms are asymmetrically raised, and the golden-hour lighting is only partly captured.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/imagineart-imagineart-input3-rooftop-35cd39c75461.png","evidence_url":"https://aidemos.com/evidence/df36f4b9-1a65-42ca-83d8-146d04d45ab4"},{"id":"06448c74-a615-4d5c-8a8e-e0784a1ac51b","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"worked","score":null,"score_total":null,"note":"It follows the rooftop, city skyline, golden-hour light and outfit correctly, even though the face angle is too extreme for identity testing.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/leonardo-ai-image-2-2f13c9b713fe.png","evidence_url":"https://aidemos.com/evidence/06448c74-a615-4d5c-8a8e-e0784a1ac51b"},{"id":"3939041b-dcde-41b5-91dd-7f76e53847cd","tool":"scenario","tool_name":"Scenario","verdict":"worked","score":null,"score_total":null,"note":"It executes the sunset rooftop prompt cleanly, including amber lighting, correct shadow fall, and the black top with beige trousers.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/scenario-scenario-input3-rooftop-be5ae814b119.png","evidence_url":"https://aidemos.com/evidence/3939041b-dcde-41b5-91dd-7f76e53847cd"}],"other_criteria":[{"id":"814ece07-861f-4833-917a-ef2eb441cac9","criterion":"accessory-and-detail-retention","criterion_name":"Accessory & detail retention","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Preserves the short dark wavy hair’s volume and texture in the stress-test output, even though the face is lightly beautified.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/814ece07-861f-4833-917a-ef2eb441cac9"},{"id":"7813fc39-8282-479d-adb5-7b09e09a84cc","criterion":"identity-preservation","criterion_name":"Identity preservation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Holds the near-profile angle closely and keeps the character recognizable, though the facial features are slightly refined and smoothed compared with the reference.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/7813fc39-8282-479d-adb5-7b09e09a84cc"}],"appears_in":[{"page_type":"ranking","slug":"consistent-ai-characters","title":"Best AI Tools for Consistent AI Characters Across Scenes and Poses","url":"https://aidemos.com/best/consistent-ai-characters","binding":"run"}],"same_scenario":[{"id":"f0e88898-addc-4e27-aaf7-43d6c35286fc","tool":"gemini","tool_name":"Gemini","verdict":"mixed","score":null,"score_total":null,"note":"The rooftop scene is only partially followed: the outfit, rooftop, skyline, and body pose are present, but the face is too frontal, the occlusion stress condition is missed, and the golden-hour lighting shifts cooler and more daytime-like."},{"id":"df36f4b9-1a65-42ca-83d8-146d04d45ab4","tool":"imagineart","tool_name":"ImagineArt","verdict":"struggled","score":null,"score_total":null,"note":"The rooftop output only partially follows the prompt: the sleeve length is wrong, the arms are asymmetrically raised, and the golden-hour lighting is only partly captured."},{"id":"06448c74-a615-4d5c-8a8e-e0784a1ac51b","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"worked","score":null,"score_total":null,"note":"It follows the rooftop, city skyline, golden-hour light and outfit correctly, even though the face angle is too extreme for identity testing."},{"id":"3939041b-dcde-41b5-91dd-7f76e53847cd","tool":"scenario","tool_name":"Scenario","verdict":"worked","score":null,"score_total":null,"note":"It executes the sunset rooftop prompt cleanly, including amber lighting, correct shadow fall, and the black top with beige trousers."}]}