{"observation":{"id":"1dd03c75-de2c-4a5b-99da-30920f49b10d","tool":"heygen","tool_name":"HeyGen","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","criterion_definition":"Relevant supporting footage or product shots, when the tool offers them.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Relevant product shots and supporting footage help determine whether the ad feels complete and convincing. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"failed","score":null,"score_total":null,"note":"The supporting footage is not product-integrated because the cutaway uses the wrong app entirely, so the B-roll does not match the Duolingo testimonial being spoken.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/61d417b345ad4d2ab66fb9eb41648b92.png?v=1","role":"context","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/e1595503067242cdbfafa0a9676f1a5a.mp4?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"heygen","tool_url":"https://aidemos.com/tools/heygen","permalink":"https://aidemos.com/evidence/1dd03c75-de2c-4a5b-99da-30920f49b10d","api_url":"https://ai.aidemos.com/v1/observations/1dd03c75-de2c-4a5b-99da-30920f49b10d"},"peers":[{"id":"45385946-2f98-44ce-a46a-9bb2f436fc45","tool":"akool","tool_name":"AKOOL","verdict":"failed","score":null,"score_total":null,"note":"Adds no app UI or other product footage at all.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ada242395b9642fdacde72d4547aafe9.mp4?v=1","evidence_url":"https://aidemos.com/evidence/45385946-2f98-44ce-a46a-9bb2f436fc45"},{"id":"107f3ac0-9c11-45b0-aa76-f6d22bddced6","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip adds a timed phone-and-coffee cutaway, but the screen content is blurred and generic instead of product-specific, so the supporting footage does not fully reinforce the app.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/fd4d673833fa40308e43c13b7b13815e.png?v=1","evidence_url":"https://aidemos.com/evidence/107f3ac0-9c11-45b0-aa76-f6d22bddced6"},{"id":"55217f13-202c-4c01-bdf0-0029a47654a7","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can produce a single static shot with no cutaways and no product visuals, so the app never gets any supporting footage.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7091a0095a044c99ac097c9e36090b10.png?v=1","evidence_url":"https://aidemos.com/evidence/55217f13-202c-4c01-bdf0-0029a47654a7"},{"id":"fccba413-4ecd-4007-96f6-3b6b356fb807","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The podcast-style output does not show the Duolingo app UI, so the ad lacks contextual app integration.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/804557dc8e114b7b881b3057d7014c4f.mp4?v=1","evidence_url":"https://aidemos.com/evidence/fccba413-4ecd-4007-96f6-3b6b356fb807"},{"id":"020fb808-2548-42dd-aa30-0115ecf673b3","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"The Duolingo output is a talking-head clip, and the report says the Duolingo UI was not automatically included, so contextual app visuals were not supplied by default.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/1de92588afe84e30b16ce1f2fa477b3e.mp4?v=1","evidence_url":"https://aidemos.com/evidence/020fb808-2548-42dd-aa30-0115ecf673b3"},{"id":"ac43a64b-f1db-44ac-9c6f-63cc090349b0","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"failed","score":null,"score_total":null,"note":"Does not add app UI or other contextual footage; the output remains a generic talking-head video with a plain background.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/f25b8326c2154e5688b7d75b8d2dc085.mp4?v=1","evidence_url":"https://aidemos.com/evidence/ac43a64b-f1db-44ac-9c6f-63cc090349b0"}],"other_criteria":[{"id":"9012a876-7dac-4276-89c3-aa9dc9ebcf9d","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Duolingo output reads as a casual creator-style presenter rather than an AI-obvious stock avatar, with the report calling the setting genuinely UGC-authentic.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/9012a876-7dac-4276-89c3-aa9dc9ebcf9d"},{"id":"563c5021-098b-4a1f-b449-465d7e93d46c","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Captions are present, but around 0:04-0:05 they overlap with a leftover badge graphic and become garbled, creating hard-to-read double-exposed text.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/563c5021-098b-4a1f-b449-465d7e93d46c"},{"id":"7e43c5e4-07e8-4b3b-8141-9f792f225667","criterion":"platform-formats","criterion_name":"Platform formats","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"This is the only run that delivers the requested full-bleed vertical 9:16 frame with no letterboxing.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/7e43c5e4-07e8-4b3b-8141-9f792f225667"},{"id":"8c0a2025-1a9c-4901-bf4c-6a1dc599c348","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Product understanding breaks in the B-roll cutaway: the phone screen shows a shopping app ('NEW YORK BAG $219, ADD TO CART') instead of Duolingo or any language-learning interface.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/8c0a2025-1a9c-4901-bf4c-6a1dc599c348"},{"id":"64e1c84b-48cc-4206-a23d-413108d746c3","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The script is delivered verbatim from start to finish and lands on a natural CTA, ending correctly on 'give Duolingo a try.'","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/64e1c84b-48cc-4206-a23d-413108d746c3"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"45385946-2f98-44ce-a46a-9bb2f436fc45","tool":"akool","tool_name":"AKOOL","verdict":"failed","score":null,"score_total":null,"note":"Adds no app UI or other product footage at all."},{"id":"107f3ac0-9c11-45b0-aa76-f6d22bddced6","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip adds a timed phone-and-coffee cutaway, but the screen content is blurred and generic instead of product-specific, so the supporting footage does not fully reinforce the app."},{"id":"55217f13-202c-4c01-bdf0-0029a47654a7","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can produce a single static shot with no cutaways and no product visuals, so the app never gets any supporting footage."},{"id":"fccba413-4ecd-4007-96f6-3b6b356fb807","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The podcast-style output does not show the Duolingo app UI, so the ad lacks contextual app integration."},{"id":"020fb808-2548-42dd-aa30-0115ecf673b3","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"The Duolingo output is a talking-head clip, and the report says the Duolingo UI was not automatically included, so contextual app visuals were not supplied by default."},{"id":"ac43a64b-f1db-44ac-9c6f-63cc090349b0","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"failed","score":null,"score_total":null,"note":"Does not add app UI or other contextual footage; the output remains a generic talking-head video with a plain background."}]}