{"observation":{"id":"a4316236-44b9-465a-84f0-c9ab5bf6f6f0","tool":"vidnoz-ai","tool_name":"Vidnoz AI","criterion":"product-understanding","criterion_name":"Product understanding","criterion_definition":"Whether the tool gets the product right in features and positioning, rather than being generic or inaccurate.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"An ad has to describe the product accurately and position it correctly; generic or wrong messaging breaks the output. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"worked","score":null,"score_total":null,"note":"Understands a language-learning app well enough to position it around short lessons, daily practice, and simple, fun learning.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/f25b8326c2154e5688b7d75b8d2dc085.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/238b93d7b2494c92a9dba9e3c5cb391d.mp4?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"vidnoz-ai","tool_url":"https://aidemos.com/tools/vidnoz-ai","permalink":"https://aidemos.com/evidence/a4316236-44b9-465a-84f0-c9ab5bf6f6f0","api_url":"https://ai.aidemos.com/v1/observations/a4316236-44b9-465a-84f0-c9ab5bf6f6f0"},"peers":[{"id":"3c8c0c8a-13ae-40cf-ad1d-841db194a417","tool":"akool","tool_name":"AKOOL","verdict":"struggled","score":null,"score_total":null,"note":"Keeps the language-learning message simple, but the output stays generic and does not make Duolingo feel distinctive.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ada242395b9642fdacde72d4547aafe9.mp4?v=1","evidence_url":"https://aidemos.com/evidence/3c8c0c8a-13ae-40cf-ad1d-841db194a417"},{"id":"946d7259-1754-4278-b787-f11518190bc8","tool":"creatify-ai","tool_name":"Creatify.ai","verdict":"mixed","score":null,"score_total":null,"note":"For the app input, the ad correctly sold language-learning convenience and daily practice, but the report says the background stayed generic and the Duolingo interface was not clearly shown.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/c2f231a60b8e4009acd41c18a618c58f.mp4?v=1","evidence_url":"https://aidemos.com/evidence/946d7259-1754-4278-b787-f11518190bc8"},{"id":"8c0a2025-1a9c-4901-bf4c-6a1dc599c348","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"Product understanding breaks in the B-roll cutaway: the phone screen shows a shopping app ('NEW YORK BAG $219, ADD TO CART') instead of Duolingo or any language-learning interface.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/61d417b345ad4d2ab66fb9eb41648b92.png?v=1","evidence_url":"https://aidemos.com/evidence/8c0a2025-1a9c-4901-bf4c-6a1dc599c348"},{"id":"7a6225f6-e4ba-40b5-b2f7-b5ee9a7ca9ba","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The output gets the brand right in the outro card, but the mid-script phone b-roll is generic message-bubble UI rather than an actual Duolingo lesson screen, so product specificity is only partial.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/fd4d673833fa40308e43c13b7b13815e.png?v=1","evidence_url":"https://aidemos.com/evidence/7a6225f6-e4ba-40b5-b2f7-b5ee9a7ca9ba"},{"id":"18b113d7-c45a-4545-84ab-834fcf4baa28","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"For an app prompt, the tool can leave out the app completely and produce only an avatar talking to camera, with no screenshot, graphic, or in-video product reference.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7091a0095a044c99ac097c9e36090b10.png?v=1","evidence_url":"https://aidemos.com/evidence/18b113d7-c45a-4545-84ab-834fcf4baa28"}],"other_criteria":[{"id":"9f14b673-95ab-49ba-85b7-39050fe8f175","criterion":"ad-readiness","criterion_name":"Ad-readiness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The clip is understandable and usable in principle, but the neutral tone, generic background, and AI-obvious presenter keep it from feeling fully ready to launch as-is.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/9f14b673-95ab-49ba-85b7-39050fe8f175"},{"id":"489c4461-ad1d-491e-a950-62376aaf9b59","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Produces a believable talking-head presenter, but the report still describes the avatar as moderately AI-generated compared with higher-end tools.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/489c4461-ad1d-491e-a950-62376aaf9b59"},{"id":"ac43a64b-f1db-44ac-9c6f-63cc090349b0","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Does not add app UI or other contextual footage; the output remains a generic talking-head video with a plain background.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/ac43a64b-f1db-44ac-9c6f-63cc090349b0"},{"id":"9594b9b0-6c3c-44e9-8cfa-8a8a2db3f6d9","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the script simple and clear, but the emotional tone stays neutral, so the promo is serviceable rather than especially compelling.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/9594b9b0-6c3c-44e9-8cfa-8a8a2db3f6d9"},{"id":"8218446d-74df-47aa-92fa-b7a69a619ce0","criterion":"voice-quality","criterion_name":"Voice quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generates a stable voice performance that remains consistent across the clip and fits the educational-app style prompt.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/8218446d-74df-47aa-92fa-b7a69a619ce0"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"3c8c0c8a-13ae-40cf-ad1d-841db194a417","tool":"akool","tool_name":"AKOOL","verdict":"struggled","score":null,"score_total":null,"note":"Keeps the language-learning message simple, but the output stays generic and does not make Duolingo feel distinctive."},{"id":"946d7259-1754-4278-b787-f11518190bc8","tool":"creatify-ai","tool_name":"Creatify.ai","verdict":"mixed","score":null,"score_total":null,"note":"For the app input, the ad correctly sold language-learning convenience and daily practice, but the report says the background stayed generic and the Duolingo interface was not clearly shown."},{"id":"8c0a2025-1a9c-4901-bf4c-6a1dc599c348","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"Product understanding breaks in the B-roll cutaway: the phone screen shows a shopping app ('NEW YORK BAG $219, ADD TO CART') instead of Duolingo or any language-learning interface."},{"id":"7a6225f6-e4ba-40b5-b2f7-b5ee9a7ca9ba","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The output gets the brand right in the outro card, but the mid-script phone b-roll is generic message-bubble UI rather than an actual Duolingo lesson screen, so product specificity is only partial."},{"id":"18b113d7-c45a-4545-84ab-834fcf4baa28","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"For an app prompt, the tool can leave out the app completely and produce only an avatar talking to camera, with no screenshot, graphic, or in-video product reference."}]}