{"observation":{"id":"65f7903c-08c2-4f33-987b-43e5e8b93aa7","tool":"chatgpt","tool_name":"ChatGPT","criterion":"identity-preservation","criterion_name":"Identity preservation","criterion_definition":"How closely the generated face matches the reference image across scenes.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"This is the core of the task: the tool must keep the same character looking like the reference image across scenes. (3 of 3 judges)","scenario":"three-quarter-face-portrait","scenario_name":"Three-quarter face portrait","group_tag":null,"scenario_description":"Three-quarter face reference image with medium-dark skin, tight curly hair in an updo, bindi, and a floral dress. The partial angle and softer lighting make it a harder reference than the frontal portrait and are meant to stress identity consistency.","modality":"image","input_text":null,"input_artifact_refs":[],"stresses":["Identity preservation with partial face angle","Hair texture and updo retention","Skin tone fidelity","Reference-image difficulty under softer lighting"],"verdict":"failed","score":null,"score_total":null,"note":"Becomes very hard to verify once the face turns too far, and the report says the bindi disappears entirely, leaving the identity lock extremely weak.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/chatgpt-chatgpt-input2-market-e9f4f835d318.png","role":"output","alt":null}],"run_id":"1dfb8fa4-f7f0-47dc-911b-7db3af467e9a","study_title":"Generate Consistent AI Characters Across Different Scenes and Poses","study_kind":"generation","research_task":"86b96df11","tested_at":null,"completeness":"output-only","input":{"state":"not-captured","text":null,"files":[],"modality":"image","stresses":["Identity preservation with partial face angle","Hair texture and updo retention","Skin tone fidelity","Reference-image difficulty under softer lighting"]},"tool_page_slug":"chatgpt","tool_url":"https://aidemos.com/tools/chatgpt","permalink":"https://aidemos.com/evidence/65f7903c-08c2-4f33-987b-43e5e8b93aa7","api_url":"https://ai.aidemos.com/v1/observations/65f7903c-08c2-4f33-987b-43e5e8b93aa7"},"peers":[{"id":"1a0bf38a-fcde-4dc7-977f-cf458af631b5","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"In the crowded market scene, the character stays highly recognisable, preserving face shape, smile, eyebrows, and overall facial structure.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-input-2-1c4e066a03c3.png","evidence_url":"https://aidemos.com/evidence/1a0bf38a-fcde-4dc7-977f-cf458af631b5"},{"id":"21c5b413-356f-4640-b66f-fe29ed449e6c","tool":"imagineart","tool_name":"ImagineArt","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output stays close to the reference in face shape, skin tone, expression, posture, and overall appearance.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/imagineart-input-2-a3afbe926005.png","evidence_url":"https://aidemos.com/evidence/21c5b413-356f-4640-b66f-fe29ed449e6c"},{"id":"0e624844-5118-4e3d-93d1-93104ff79bc8","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"On a harder 3/4 reference, it can keep face shape, skin tone and eyebrows close, but the hair geometry drifts enough that the result is only partly faithful.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/leonardo-ai-image-95c2a8e685d7.png","evidence_url":"https://aidemos.com/evidence/0e624844-5118-4e3d-93d1-93104ff79bc8"},{"id":"6afd9a45-ca4d-4336-9bf1-660ad4e41244","tool":"scenario","tool_name":"Scenario","verdict":"struggled","score":null,"score_total":null,"note":"Identity drifts in a crowded full-body scene, with a narrower jawline and a thinner body making the result read as a similar-looking person rather than the same subject.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/scenario-scenario-input2-market-f1d754c6924c.png","evidence_url":"https://aidemos.com/evidence/6afd9a45-ca4d-4336-9bf1-660ad4e41244"}],"other_criteria":[{"id":"e922f661-f08e-4080-b888-372f905ec1c7","criterion":"accessory-and-detail-retention","criterion_name":"Accessory & detail retention","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Retains the bindi and strong brows in the frontal output, while only slightly darkening skin tone relative to the reference.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/e922f661-f08e-4080-b888-372f905ec1c7"},{"id":"8b496d76-afd9-4658-b0a0-2b73533010ff","criterion":"expression-accuracy","criterion_name":"Expression accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Delivers the requested cold, guarded, unsmiling expression with the exact vibe the prompt asked for.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/8b496d76-afd9-4658-b0a0-2b73533010ff"},{"id":"8e6c6b91-aa81-4f53-bbf7-a4fb3b34dbef","criterion":"scene-compliance","criterion_name":"Scene compliance","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Cleansly follows the interrogation-room prompt with the navy shirt, hands flat on the table, and bare room composition all in place.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/8e6c6b91-aa81-4f53-bbf7-a4fb3b34dbef"},{"id":"c3fba2ff-eb7e-4ef1-9658-7af7cce5d52c","criterion":"scene-compliance","criterion_name":"Scene compliance","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Executes the market scene strongly: the crowd feels authentic, the mustard sari and red blouse match the prompt, and the jute bag with vegetables is present.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/c3fba2ff-eb7e-4ef1-9658-7af7cce5d52c"}],"appears_in":[{"page_type":"ranking","slug":"consistent-ai-characters","title":"Best AI Tools for Consistent AI Characters Across Scenes and Poses","url":"https://aidemos.com/best/consistent-ai-characters","binding":"run"}],"same_scenario":[{"id":"1a0bf38a-fcde-4dc7-977f-cf458af631b5","tool":"gemini","tool_name":"Gemini","verdict":"worked","score":null,"score_total":null,"note":"In the crowded market scene, the character stays highly recognisable, preserving face shape, smile, eyebrows, and overall facial structure."},{"id":"21c5b413-356f-4640-b66f-fe29ed449e6c","tool":"imagineart","tool_name":"ImagineArt","verdict":"worked","score":null,"score_total":null,"note":"The interrogation-room output stays close to the reference in face shape, skin tone, expression, posture, and overall appearance."},{"id":"0e624844-5118-4e3d-93d1-93104ff79bc8","tool":"leonardo-ai","tool_name":"Leonardo AI","verdict":"mixed","score":null,"score_total":null,"note":"On a harder 3/4 reference, it can keep face shape, skin tone and eyebrows close, but the hair geometry drifts enough that the result is only partly faithful."},{"id":"6afd9a45-ca4d-4336-9bf1-660ad4e41244","tool":"scenario","tool_name":"Scenario","verdict":"struggled","score":null,"score_total":null,"note":"Identity drifts in a crowded full-body scene, with a narrower jawline and a thinner body making the result read as a similar-looking person rather than the same subject."}]}