{"observation":{"id":"4db20ba1-6e74-4050-9a0d-363b7b367453","tool":"invideo-ai","tool_name":"Invideo AI","criterion":"caption-quality","criterion_name":"Caption quality","criterion_definition":"Accurate, well-timed captions with appropriate, on-trend styling.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Accurate, well-timed captions are part of the finished ad and affect clarity and performance on social platforms. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"mixed","score":null,"score_total":null,"note":"The captions visibly advance across the clip and support the CTA line, but the report does not separately validate timing or styling beyond the sampled frame progression.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/2d708f66a6554c76aa83c81aa49797c7.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/e48056a702784f44965a5dec6c18e98b.mp4?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"invideo-ai","tool_url":"https://aidemos.com/tools/invideo-ai","permalink":"https://aidemos.com/evidence/4db20ba1-6e74-4050-9a0d-363b7b367453","api_url":"https://ai.aidemos.com/v1/observations/4db20ba1-6e74-4050-9a0d-363b7b367453"},"peers":[{"id":"563c5021-098b-4a1f-b449-465d7e93d46c","tool":"heygen","tool_name":"HeyGen","verdict":"mixed","score":null,"score_total":null,"note":"Captions are present, but around 0:04-0:05 they overlap with a leftover badge graphic and become garbled, creating hard-to-read double-exposed text.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b1c9519dde064a1384d3dbe89454fb49.png?v=1","evidence_url":"https://aidemos.com/evidence/563c5021-098b-4a1f-b449-465d7e93d46c"},{"id":"e12d44db-bb16-4a23-be8b-d93b69e44efc","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 13.5 seconds, so subtitles are absent even on a mobile-app promo.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7091a0095a044c99ac097c9e36090b10.png?v=1","evidence_url":"https://aidemos.com/evidence/e12d44db-bb16-4a23-be8b-d93b69e44efc"},{"id":"89287467-a094-457a-bb5c-bccb2ec831e4","tool":"topview-ai","tool_name":"Topview AI","verdict":"worked","score":null,"score_total":null,"note":"Captions were generated and readable.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/804557dc8e114b7b881b3057d7014c4f.mp4?v=1","evidence_url":"https://aidemos.com/evidence/89287467-a094-457a-bb5c-bccb2ec831e4"}],"other_criteria":[{"id":"9493dd01-fa8e-41e2-879b-0214836a5a08","criterion":"ad-readiness","criterion_name":"Ad-readiness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The clip is branded and complete, but the generic b-roll and non-clickable end card make it less action-ready as a paid ad without another review pass.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/9493dd01-fa8e-41e2-879b-0214836a5a08"},{"id":"7161f9f6-898f-46f1-907c-50a97ff79b05","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The presenter reads as a consistent human avatar with a clean UGC look throughout the clip, with no obvious flicker or identity break reported.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/7161f9f6-898f-46f1-907c-50a97ff79b05"},{"id":"107f3ac0-9c11-45b0-aa76-f6d22bddced6","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The clip adds a timed phone-and-coffee cutaway, but the screen content is blurred and generic instead of product-specific, so the supporting footage does not fully reinforce the app.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/107f3ac0-9c11-45b0-aa76-f6d22bddced6"},{"id":"7a6225f6-e4ba-40b5-b2f7-b5ee9a7ca9ba","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The output gets the brand right in the outro card, but the mid-script phone b-roll is generic message-bubble UI rather than an actual Duolingo lesson screen, so product specificity is only partial.","artifact_count":4,"evidence_url":"https://aidemos.com/evidence/7a6225f6-e4ba-40b5-b2f7-b5ee9a7ca9ba"},{"id":"8af2d396-37c8-4209-83b4-31ab2c9fbea0","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The script is reproduced verbatim and reaches the closing CTA line without truncation, so the testimonial structure and call-to-action remain intact.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/8af2d396-37c8-4209-83b4-31ab2c9fbea0"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"563c5021-098b-4a1f-b449-465d7e93d46c","tool":"heygen","tool_name":"HeyGen","verdict":"mixed","score":null,"score_total":null,"note":"Captions are present, but around 0:04-0:05 they overlap with a leftover badge graphic and become garbled, creating hard-to-read double-exposed text."},{"id":"e12d44db-bb16-4a23-be8b-d93b69e44efc","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 13.5 seconds, so subtitles are absent even on a mobile-app promo."},{"id":"89287467-a094-457a-bb5c-bccb2ec831e4","tool":"topview-ai","tool_name":"Topview AI","verdict":"worked","score":null,"score_total":null,"note":"Captions were generated and readable."}]}