{"observation":{"id":"45385946-2f98-44ce-a46a-9bb2f436fc45","tool":"akool","tool_name":"AKOOL","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","criterion_definition":"Relevant supporting footage or product shots, when the tool offers them.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Relevant product shots and supporting footage help determine whether the ad feels complete and convincing. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"failed","score":null,"score_total":null,"note":"Adds no app UI or other product footage at all.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/ada242395b9642fdacde72d4547aafe9.mp4?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"akool","tool_url":"https://aidemos.com/tools/akool","permalink":"https://aidemos.com/evidence/45385946-2f98-44ce-a46a-9bb2f436fc45","api_url":"https://ai.aidemos.com/v1/observations/45385946-2f98-44ce-a46a-9bb2f436fc45"},"peers":[{"id":"1dd03c75-de2c-4a5b-99da-30920f49b10d","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"The supporting footage is not product-integrated because the cutaway uses the wrong app entirely, so the B-roll does not match the Duolingo testimonial being spoken.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/61d417b345ad4d2ab66fb9eb41648b92.png?v=1","evidence_url":"https://aidemos.com/evidence/1dd03c75-de2c-4a5b-99da-30920f49b10d"},{"id":"107f3ac0-9c11-45b0-aa76-f6d22bddced6","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip adds a timed phone-and-coffee cutaway, but the screen content is blurred and generic instead of product-specific, so the supporting footage does not fully reinforce the app.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/fd4d673833fa40308e43c13b7b13815e.png?v=1","evidence_url":"https://aidemos.com/evidence/107f3ac0-9c11-45b0-aa76-f6d22bddced6"},{"id":"55217f13-202c-4c01-bdf0-0029a47654a7","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can produce a single static shot with no cutaways and no product visuals, so the app never gets any supporting footage.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7091a0095a044c99ac097c9e36090b10.png?v=1","evidence_url":"https://aidemos.com/evidence/55217f13-202c-4c01-bdf0-0029a47654a7"},{"id":"fccba413-4ecd-4007-96f6-3b6b356fb807","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The podcast-style output does not show the Duolingo app UI, so the ad lacks contextual app integration.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/804557dc8e114b7b881b3057d7014c4f.mp4?v=1","evidence_url":"https://aidemos.com/evidence/fccba413-4ecd-4007-96f6-3b6b356fb807"},{"id":"020fb808-2548-42dd-aa30-0115ecf673b3","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"The Duolingo output is a talking-head clip, and the report says the Duolingo UI was not automatically included, so contextual app visuals were not supplied by default.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/1de92588afe84e30b16ce1f2fa477b3e.mp4?v=1","evidence_url":"https://aidemos.com/evidence/020fb808-2548-42dd-aa30-0115ecf673b3"},{"id":"ac43a64b-f1db-44ac-9c6f-63cc090349b0","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"failed","score":null,"score_total":null,"note":"Does not add app UI or other contextual footage; the output remains a generic talking-head video with a plain background.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/f25b8326c2154e5688b7d75b8d2dc085.mp4?v=1","evidence_url":"https://aidemos.com/evidence/ac43a64b-f1db-44ac-9c6f-63cc090349b0"}],"other_criteria":[{"id":"762943db-0f98-436c-99f7-ca2389e72d99","criterion":"ad-readiness","criterion_name":"Ad-readiness","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The export succeeds, but the generic background, flat tone, and lack of app UI mean it is not ready to run unchanged as a paid ad.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/762943db-0f98-436c-99f7-ca2389e72d99"},{"id":"67d03d68-a3e0-4842-b3fb-3d74eed26da6","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The presenter is serviceable, but the avatar still looks moderately AI-generated rather than high-end realistic.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/67d03d68-a3e0-4842-b3fb-3d74eed26da6"},{"id":"3c8c0c8a-13ae-40cf-ad1d-841db194a417","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Keeps the language-learning message simple, but the output stays generic and does not make Duolingo feel distinctive.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/3c8c0c8a-13ae-40cf-ad1d-841db194a417"},{"id":"92102361-70c1-4a8d-a50d-e67a18a661a1","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Communicates the app benefits clearly, but the tone is flat and less engaging, so the UGC pitch is only mildly persuasive.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/92102361-70c1-4a8d-a50d-e67a18a661a1"},{"id":"e1c671b1-a7b3-43dc-934e-5e02e99928e0","criterion":"voice-quality","criterion_name":"Voice quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Voice output stays consistent and stable across the video.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/e1c671b1-a7b3-43dc-934e-5e02e99928e0"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"1dd03c75-de2c-4a5b-99da-30920f49b10d","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"The supporting footage is not product-integrated because the cutaway uses the wrong app entirely, so the B-roll does not match the Duolingo testimonial being spoken."},{"id":"107f3ac0-9c11-45b0-aa76-f6d22bddced6","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip adds a timed phone-and-coffee cutaway, but the screen content is blurred and generic instead of product-specific, so the supporting footage does not fully reinforce the app."},{"id":"55217f13-202c-4c01-bdf0-0029a47654a7","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can produce a single static shot with no cutaways and no product visuals, so the app never gets any supporting footage."},{"id":"fccba413-4ecd-4007-96f6-3b6b356fb807","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The podcast-style output does not show the Duolingo app UI, so the ad lacks contextual app integration."},{"id":"020fb808-2548-42dd-aa30-0115ecf673b3","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"The Duolingo output is a talking-head clip, and the report says the Duolingo UI was not automatically included, so contextual app visuals were not supplied by default."},{"id":"ac43a64b-f1db-44ac-9c6f-63cc090349b0","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"failed","score":null,"score_total":null,"note":"Does not add app UI or other contextual footage; the output remains a generic talking-head video with a plain background."}]}