{"observation":{"id":"579419d7-0f47-43cb-8d1b-1536ddea14c4","tool":"synthesia","tool_name":"Synthesia","criterion":"ad-readiness","criterion_name":"Ad-readiness","criterion_definition":"Whether the output could actually be run as a paid ad as-is.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If the output cannot be run as a paid ad as-is, the tool has not really delivered the finished product the user wants. (3 of 3 judges)","scenario":"duolingo-mobile-app","scenario_name":"Duolingo – Mobile App","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC promo prompt for a consumer mobile app, designed to test whether the tool can explain app benefits simply and persuasively while generating a realistic AI-presenter video.","modality":"mixed","input_text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"failed","score":null,"score_total":null,"note":"The Duolingo ad was not runnable as-is because downloading required an upgraded plan and the output stayed landscape instead of vertical.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/ea4c634e3873477ba8e836f199738bcc.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/321b29e5d73a4e3c94a7d007333c5863.png?v=1","role":"context","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.duolingo.com/\n\nExact script:\nHook: Learning a new language has never been this easy.\nScript: I've been using Duolingo for a few minutes every day, and it's made language learning simple and fun. The short lessons are easy to follow, and the daily practice keeps me motivated. If you're planning to learn a new language, give Duolingo a try.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Mobile app understanding","Consumer app promotion","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"synthesia","tool_url":"https://aidemos.com/tools/synthesia","permalink":"https://aidemos.com/evidence/579419d7-0f47-43cb-8d1b-1536ddea14c4","api_url":"https://ai.aidemos.com/v1/observations/579419d7-0f47-43cb-8d1b-1536ddea14c4"},"peers":[{"id":"762943db-0f98-436c-99f7-ca2389e72d99","tool":"akool","tool_name":"AKOOL","verdict":"struggled","score":null,"score_total":null,"note":"The export succeeds, but the generic background, flat tone, and lack of app UI mean it is not ready to run unchanged as a paid ad.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ada242395b9642fdacde72d4547aafe9.mp4?v=1","evidence_url":"https://aidemos.com/evidence/762943db-0f98-436c-99f7-ca2389e72d99"},{"id":"3705b171-5b1c-458a-a2da-4a6b2e625a03","tool":"dreamface","tool_name":"DreamFace","verdict":"struggled","score":null,"score_total":null,"note":"The Duolingo output reads like a corporate webinar presenter in an office rather than a casual personal UGC testimonial, so it undercuts the requested ad-native feel.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/9d196365728448f4ae87b208d048e5eb.png?v=1","evidence_url":"https://aidemos.com/evidence/3705b171-5b1c-458a-a2da-4a6b2e625a03"},{"id":"9493dd01-fa8e-41e2-879b-0214836a5a08","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip is branded and complete, but the generic b-roll and non-clickable end card make it less action-ready as a paid ad without another review pass.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/fd4d673833fa40308e43c13b7b13815e.png?v=1","evidence_url":"https://aidemos.com/evidence/9493dd01-fa8e-41e2-879b-0214836a5a08"},{"id":"9f14b673-95ab-49ba-85b7-39050fe8f175","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip is understandable and usable in principle, but the neutral tone, generic background, and AI-obvious presenter keep it from feeling fully ready to launch as-is.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/f25b8326c2154e5688b7d75b8d2dc085.mp4?v=1","evidence_url":"https://aidemos.com/evidence/9f14b673-95ab-49ba-85b7-39050fe8f175"}],"other_criteria":[{"id":"a822e15b-a091-4f92-8344-d0bf07c19660","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Duolingo output used a smooth, centered talking-head avatar, and the report says lip-sync accuracy was maintained.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a822e15b-a091-4f92-8344-d0bf07c19660"},{"id":"f410dd67-fcba-4ee3-ac8e-1336e9dd7204","criterion":"platform-formats","criterion_name":"Platform formats","rank_role":"context","verdict":"failed","score":null,"score_total":null,"note":"The Duolingo output was generated in landscape rather than the requested vertical 9:16 short-form format.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/f410dd67-fcba-4ee3-ac8e-1336e9dd7204"},{"id":"b90aa48d-0aa8-4205-a720-db42358970da","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The Duolingo script explained the app benefits clearly, but the report says the presentation felt less engaging for UGC ads and had limited emotional expressiveness.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/b90aa48d-0aa8-4205-a720-db42358970da"},{"id":"b2ef26b2-2972-4c88-96b0-547d48165f9f","criterion":"voice-quality","criterion_name":"Voice quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Duolingo voice was reported as clear and well-paced, with no technical issues during generation.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/b2ef26b2-2972-4c88-96b0-547d48165f9f"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"762943db-0f98-436c-99f7-ca2389e72d99","tool":"akool","tool_name":"AKOOL","verdict":"struggled","score":null,"score_total":null,"note":"The export succeeds, but the generic background, flat tone, and lack of app UI mean it is not ready to run unchanged as a paid ad."},{"id":"3705b171-5b1c-458a-a2da-4a6b2e625a03","tool":"dreamface","tool_name":"DreamFace","verdict":"struggled","score":null,"score_total":null,"note":"The Duolingo output reads like a corporate webinar presenter in an office rather than a casual personal UGC testimonial, so it undercuts the requested ad-native feel."},{"id":"9493dd01-fa8e-41e2-879b-0214836a5a08","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip is branded and complete, but the generic b-roll and non-clickable end card make it less action-ready as a paid ad without another review pass."},{"id":"9f14b673-95ab-49ba-85b7-39050fe8f175","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"mixed","score":null,"score_total":null,"note":"The clip is understandable and usable in principle, but the neutral tone, generic background, and AI-obvious presenter keep it from feeling fully ready to launch as-is."}]}