{"observation":{"id":"e75de6e5-97b8-48d2-90f8-c5683380af19","tool":"heygen","tool_name":"HeyGen","criterion":"caption-quality","criterion_name":"Caption quality","criterion_definition":"Accurate, well-timed captions with appropriate, on-trend styling.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Accurate, well-timed captions are part of the finished ad and affect clarity and performance on social platforms. (3 of 3 judges)","scenario":"nike-pegasus-41-physical-product","scenario_name":"Nike Pegasus 41 – Physical Product","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC testimonial prompt for a physical consumer product, designed to test product comprehension, believable praise for a running shoe, and ad-style video generation quality.","modality":"mixed","input_text":"Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002\n\nExact script:\nHook: These are my new favorite running shoes.\nScript: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Physical product understanding","UGC testimonial quality","Product presentation","Avatar realism","Voice quality","Commercial ad readiness"],"verdict":"worked","score":null,"score_total":null,"note":"Captions run throughout the Nike clip, and the output shows subtitles advancing with the spoken lines instead of disappearing mid-video.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/77f0599bfa52427a99725c88fb03c98f.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/3972776f54954f51a8880acdf7c95556.png?v=1","role":"context","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002\n\nExact script:\nHook: These are my new favorite running shoes.\nScript: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Physical product understanding","UGC testimonial quality","Product presentation","Avatar realism","Voice quality","Commercial ad readiness"]},"tool_page_slug":"heygen","tool_url":"https://aidemos.com/tools/heygen","permalink":"https://aidemos.com/evidence/e75de6e5-97b8-48d2-90f8-c5683380af19","api_url":"https://ai.aidemos.com/v1/observations/e75de6e5-97b8-48d2-90f8-c5683380af19"},"peers":[{"id":"ada57817-d6ac-4380-b6a7-10fc7063f7ab","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"Captions are present and advance with the copy, but the report does not separately verify timing or styling on this input beyond the visible subtitle progression.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/dc64594449d3425abe47654218566644.mp4?v=1","evidence_url":"https://aidemos.com/evidence/ada57817-d6ac-4380-b6a7-10fc7063f7ab"},{"id":"6e6b5570-06cf-4508-abe2-cf25cffb584d","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 15.8 seconds, leaving the short-form ad uncaptioned.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a6a80555444b433e8edc346853fb7b07.png?v=1","evidence_url":"https://aidemos.com/evidence/6e6b5570-06cf-4508-abe2-cf25cffb584d"},{"id":"434d0563-3658-4382-ae38-de17764a7960","tool":"topview-ai","tool_name":"Topview AI","verdict":"worked","score":null,"score_total":null,"note":"Captions were generated automatically and were readable.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/9d6cdf5aeb254fda939a5e7d8f2deea3.mp4?v=1","evidence_url":"https://aidemos.com/evidence/434d0563-3658-4382-ae38-de17764a7960"}],"other_criteria":[{"id":"0ed5772b-3529-446f-9085-4e2a3be0eb26","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Nike output keeps a consistent, natural-looking on-camera presenter with stable identity and wardrobe, and the report says the avatar rendering holds up well throughout the clip.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/0ed5772b-3529-446f-9085-4e2a3be0eb26"},{"id":"a2591592-a3fd-4739-b962-a7158f5c1f3f","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The Nike output includes relevant running lifestyle b-roll, but one outdoor running shot contains a visible semi-transparent smear/compositing glitch on the runner's leg.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a2591592-a3fd-4739-b962-a7158f5c1f3f"},{"id":"9d549e62-2e55-4a01-9969-3063ac3d3c06","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The video integrates relevant product close-ups and running lifestyle footage, with a correctly rendered Nike swoosh, 'PEGASUS 41' label, and 'ZOOM' branding in the shoe shot.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/9d549e62-2e55-4a01-9969-3063ac3d3c06"},{"id":"c011acaf-5710-42f7-9d0e-19d55611c585","criterion":"platform-formats","criterion_name":"Platform formats","rank_role":"context","verdict":"failed","score":null,"score_total":null,"note":"The export comes out as a 1920x1080 widescreen video, not the requested vertical 9:16 UGC format for TikTok/Reels/Shorts.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/c011acaf-5710-42f7-9d0e-19d55611c585"},{"id":"64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"It understands the product well enough to surface the correct Pegasus 41 branding and real Nike tech claims such as ReactX foam, +13% energy return, and Dual Zoom Air.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4"},{"id":"9293a2e8-227a-4050-bbd3-8c4e25b9c2a4","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The tool assembles a persuasive ad structure with a hook, product B-roll, feature overlays, and a CTA end card, but it rewrites the supplied copy by adding technical claims that were not in the prompt.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/9293a2e8-227a-4050-bbd3-8c4e25b9c2a4"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"ada57817-d6ac-4380-b6a7-10fc7063f7ab","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"mixed","score":null,"score_total":null,"note":"Captions are present and advance with the copy, but the report does not separately verify timing or styling on this input beyond the visible subtitle progression."},{"id":"6e6b5570-06cf-4508-abe2-cf25cffb584d","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 15.8 seconds, leaving the short-form ad uncaptioned."},{"id":"434d0563-3658-4382-ae38-de17764a7960","tool":"topview-ai","tool_name":"Topview AI","verdict":"worked","score":null,"score_total":null,"note":"Captions were generated automatically and were readable."}]}