{"observation":{"id":"9012a876-7dac-4276-89c3-aa9dc9ebcf9d","tool":"heygen","tool_name":"HeyGen","criterion":"avatar-realism","criterion_name":"Avatar realism","criterion_definition":"Believable presenter; accurate lip-sync; how uncanny or AI-obvious the presenter looks.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If the presenter looks fake or lip-sync is off, the ad fails at the core UGC avatar job. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"worked","score":null,"score_total":null,"note":"The Duolingo output reads as a casual creator-style presenter rather than an AI-obvious stock avatar, with the report calling the setting genuinely UGC-authentic.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/e1595503067242cdbfafa0a9676f1a5a.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/a0b2311baf1448ae92d376cb35e9dd75.mp4?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"heygen","tool_url":"https://aidemos.com/tools/heygen","permalink":"https://aidemos.com/evidence/9012a876-7dac-4276-89c3-aa9dc9ebcf9d","api_url":"https://ai.aidemos.com/v1/observations/9012a876-7dac-4276-89c3-aa9dc9ebcf9d"},"peers":[{"id":"67d03d68-a3e0-4842-b3fb-3d74eed26da6","tool":"akool","tool_name":"AKOOL","verdict":"mixed","score":null,"score_total":null,"note":"The presenter is serviceable, but the avatar still looks moderately AI-generated rather than high-end realistic.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ada242395b9642fdacde72d4547aafe9.mp4?v=1","evidence_url":"https://aidemos.com/evidence/67d03d68-a3e0-4842-b3fb-3d74eed26da6"},{"id":"63626937-61a4-48f4-96d2-3e6b79f8a8ba","tool":"dreamface","tool_name":"DreamFace","verdict":"mixed","score":null,"score_total":null,"note":"The Duolingo avatar has good facial realism and natural gestures/weight shifting, but the right hand turns into a smooth mitten-like blob around 0:11.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/326fff910d734e64af5d6b2b3c668b24.mp4?v=1","evidence_url":"https://aidemos.com/evidence/63626937-61a4-48f4-96d2-3e6b79f8a8ba"},{"id":"7161f9f6-898f-46f1-907c-50a97ff79b05","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"worked","score":null,"score_total":null,"note":"The presenter reads as a consistent human avatar with a clean UGC look throughout the clip, with no obvious flicker or identity break reported.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/2d708f66a6554c76aa83c81aa49797c7.mp4?v=1","evidence_url":"https://aidemos.com/evidence/7161f9f6-898f-46f1-907c-50a97ff79b05"},{"id":"b5bf84f3-e76a-41ce-a229-dbd3528280ed","tool":"joggai","tool_name":"JoggAI","verdict":"worked","score":null,"score_total":null,"note":"Generates a strong-looking photorealistic avatar with no visible artifacts; the report says the face, hair, and teeth look natural even in a wide smile.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/abcbc5e48bb14dc99f8490b2808cf261.mp4?v=1","evidence_url":"https://aidemos.com/evidence/b5bf84f3-e76a-41ce-a229-dbd3528280ed"},{"id":"a822e15b-a091-4f92-8344-d0bf07c19660","tool":"synthesia","tool_name":"Synthesia","verdict":"worked","score":null,"score_total":null,"note":"The Duolingo output used a smooth, centered talking-head avatar, and the report says lip-sync accuracy was maintained.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ea4c634e3873477ba8e836f199738bcc.mp4?v=1","evidence_url":"https://aidemos.com/evidence/a822e15b-a091-4f92-8344-d0bf07c19660"},{"id":"6a41cd91-74b9-464b-9b3f-6fdefbfccc7b","tool":"topview-ai","tool_name":"Topview AI","verdict":"mixed","score":null,"score_total":null,"note":"The avatar remains visible and moves slightly, but the report describes the presenter as more AI-like than premium tools.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/804557dc8e114b7b881b3057d7014c4f.mp4?v=1","evidence_url":"https://aidemos.com/evidence/6a41cd91-74b9-464b-9b3f-6fdefbfccc7b"},{"id":"489c4461-ad1d-491e-a950-62376aaf9b59","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"mixed","score":null,"score_total":null,"note":"Produces a believable talking-head presenter, but the report still describes the avatar as moderately AI-generated compared with higher-end tools.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/f25b8326c2154e5688b7d75b8d2dc085.mp4?v=1","evidence_url":"https://aidemos.com/evidence/489c4461-ad1d-491e-a950-62376aaf9b59"}],"other_criteria":[{"id":"1dd03c75-de2c-4a5b-99da-30920f49b10d","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The supporting footage is not product-integrated because the cutaway uses the wrong app entirely, so the B-roll does not match the Duolingo testimonial being spoken.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/1dd03c75-de2c-4a5b-99da-30920f49b10d"},{"id":"563c5021-098b-4a1f-b449-465d7e93d46c","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Captions are present, but around 0:04-0:05 they overlap with a leftover badge graphic and become garbled, creating hard-to-read double-exposed text.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/563c5021-098b-4a1f-b449-465d7e93d46c"},{"id":"7e43c5e4-07e8-4b3b-8141-9f792f225667","criterion":"platform-formats","criterion_name":"Platform formats","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"This is the only run that delivers the requested full-bleed vertical 9:16 frame with no letterboxing.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/7e43c5e4-07e8-4b3b-8141-9f792f225667"},{"id":"8c0a2025-1a9c-4901-bf4c-6a1dc599c348","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Product understanding breaks in the B-roll cutaway: the phone screen shows a shopping app ('NEW YORK BAG $219, ADD TO CART') instead of Duolingo or any language-learning interface.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/8c0a2025-1a9c-4901-bf4c-6a1dc599c348"},{"id":"64e1c84b-48cc-4206-a23d-413108d746c3","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The script is delivered verbatim from start to finish and lands on a natural CTA, ending correctly on 'give Duolingo a try.'","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/64e1c84b-48cc-4206-a23d-413108d746c3"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"67d03d68-a3e0-4842-b3fb-3d74eed26da6","tool":"akool","tool_name":"AKOOL","verdict":"mixed","score":null,"score_total":null,"note":"The presenter is serviceable, but the avatar still looks moderately AI-generated rather than high-end realistic."},{"id":"63626937-61a4-48f4-96d2-3e6b79f8a8ba","tool":"dreamface","tool_name":"DreamFace","verdict":"mixed","score":null,"score_total":null,"note":"The Duolingo avatar has good facial realism and natural gestures/weight shifting, but the right hand turns into a smooth mitten-like blob around 0:11."},{"id":"7161f9f6-898f-46f1-907c-50a97ff79b05","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"worked","score":null,"score_total":null,"note":"The presenter reads as a consistent human avatar with a clean UGC look throughout the clip, with no obvious flicker or identity break reported."},{"id":"b5bf84f3-e76a-41ce-a229-dbd3528280ed","tool":"joggai","tool_name":"JoggAI","verdict":"worked","score":null,"score_total":null,"note":"Generates a strong-looking photorealistic avatar with no visible artifacts; the report says the face, hair, and teeth look natural even in a wide smile."},{"id":"a822e15b-a091-4f92-8344-d0bf07c19660","tool":"synthesia","tool_name":"Synthesia","verdict":"worked","score":null,"score_total":null,"note":"The Duolingo output used a smooth, centered talking-head avatar, and the report says lip-sync accuracy was maintained."},{"id":"6a41cd91-74b9-464b-9b3f-6fdefbfccc7b","tool":"topview-ai","tool_name":"Topview AI","verdict":"mixed","score":null,"score_total":null,"note":"The avatar remains visible and moves slightly, but the report describes the presenter as more AI-like than premium tools."},{"id":"489c4461-ad1d-491e-a950-62376aaf9b59","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"mixed","score":null,"score_total":null,"note":"Produces a believable talking-head presenter, but the report still describes the avatar as moderately AI-generated compared with higher-end tools."}]}