{"observation":{"id":"f84f33f2-0eea-4a05-a0fb-4f7ed2dd4041","tool":"joggai","tool_name":"JoggAI","criterion":"platform-formats","criterion_name":"Platform formats","criterion_definition":"Correct aspect ratios and lengths for each channel or short-form platform.","criterion_evidence_type":"transformation","criterion_rank_role":"context","criterion_rank_role_reason":"Aspect ratios and length presets are delivery convenience; they matter, but they do not by themselves make the ad better or worse. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"mixed","score":null,"score_total":null,"note":"The export format is correct at full-bleed vertical 9:16 (1080×1920), but the clip is only 13.5 seconds long, below the requested 20–30 second range.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/abcbc5e48bb14dc99f8490b2808cf261.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/7091a0095a044c99ac097c9e36090b10.png?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"joggai","tool_url":"https://aidemos.com/tools/joggai","permalink":"https://aidemos.com/evidence/f84f33f2-0eea-4a05-a0fb-4f7ed2dd4041","api_url":"https://ai.aidemos.com/v1/observations/f84f33f2-0eea-4a05-a0fb-4f7ed2dd4041"},"peers":[{"id":"7e43c5e4-07e8-4b3b-8141-9f792f225667","tool":"heygen","tool_name":"HeyGen","verdict":"worked","score":null,"score_total":null,"note":"This is the only run that delivers the requested full-bleed vertical 9:16 frame with no letterboxing.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/e1595503067242cdbfafa0a9676f1a5a.mp4?v=1","evidence_url":"https://aidemos.com/evidence/7e43c5e4-07e8-4b3b-8141-9f792f225667"},{"id":"f410dd67-fcba-4ee3-ac8e-1336e9dd7204","tool":"synthesia","tool_name":"Synthesia","verdict":"failed","score":null,"score_total":null,"note":"The Duolingo output was generated in landscape rather than the requested vertical 9:16 short-form format.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ea4c634e3873477ba8e836f199738bcc.mp4?v=1","evidence_url":"https://aidemos.com/evidence/f410dd67-fcba-4ee3-ac8e-1336e9dd7204"}],"other_criteria":[{"id":"b5bf84f3-e76a-41ce-a229-dbd3528280ed","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generates a strong-looking photorealistic avatar with no visible artifacts; the report says the face, hair, and teeth look natural even in a wide smile.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/b5bf84f3-e76a-41ce-a229-dbd3528280ed"},{"id":"55217f13-202c-4c01-bdf0-0029a47654a7","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The tool can produce a single static shot with no cutaways and no product visuals, so the app never gets any supporting footage.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/55217f13-202c-4c01-bdf0-0029a47654a7"},{"id":"e12d44db-bb16-4a23-be8b-d93b69e44efc","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 13.5 seconds, so subtitles are absent even on a mobile-app promo.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/e12d44db-bb16-4a23-be8b-d93b69e44efc"},{"id":"18b113d7-c45a-4545-84ab-834fcf4baa28","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"For an app prompt, the tool can leave out the app completely and produce only an avatar talking to camera, with no screenshot, graphic, or in-video product reference.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/18b113d7-c45a-4545-84ab-834fcf4baa28"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"7e43c5e4-07e8-4b3b-8141-9f792f225667","tool":"heygen","tool_name":"HeyGen","verdict":"worked","score":null,"score_total":null,"note":"This is the only run that delivers the requested full-bleed vertical 9:16 frame with no letterboxing."},{"id":"f410dd67-fcba-4ee3-ac8e-1336e9dd7204","tool":"synthesia","tool_name":"Synthesia","verdict":"failed","score":null,"score_total":null,"note":"The Duolingo output was generated in landscape rather than the requested vertical 9:16 short-form format."}]}