{"observation":{"id":"c011acaf-5710-42f7-9d0e-19d55611c585","tool":"heygen","tool_name":"HeyGen","criterion":"platform-formats","criterion_name":"Platform formats","criterion_definition":"Correct aspect ratios and lengths for each channel or short-form platform.","criterion_evidence_type":"transformation","criterion_rank_role":"context","criterion_rank_role_reason":"Aspect ratios and length presets are delivery convenience; they matter, but they do not by themselves make the ad better or worse. (3 of 3 judges)","scenario":"nike-pegasus-41-physical-product","scenario_name":"Nike Pegasus 41 – Physical Product","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC testimonial prompt for a physical consumer product, designed to test product comprehension, believable praise for a running shoe, and ad-style video generation quality.","modality":"mixed","input_text":"Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002\n\nExact script:\nHook: These are my new favorite running shoes.\nScript: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Physical product understanding","UGC testimonial quality","Product presentation","Avatar realism","Voice quality","Commercial ad readiness"],"verdict":"failed","score":null,"score_total":null,"note":"The export comes out as a 1920x1080 widescreen video, not the requested vertical 9:16 UGC format for TikTok/Reels/Shorts.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/466d7bd9ff134ee3af8d66fcf9e978cc.png?v=1","role":"context","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/77f0599bfa52427a99725c88fb03c98f.mp4?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002\n\nExact script:\nHook: These are my new favorite running shoes.\nScript: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Physical product understanding","UGC testimonial quality","Product presentation","Avatar realism","Voice quality","Commercial ad readiness"]},"tool_page_slug":"heygen","tool_url":"https://aidemos.com/tools/heygen","permalink":"https://aidemos.com/evidence/c011acaf-5710-42f7-9d0e-19d55611c585","api_url":"https://ai.aidemos.com/v1/observations/c011acaf-5710-42f7-9d0e-19d55611c585"},"peers":[{"id":"4ad029eb-e232-40e8-96d6-dd77cd955d68","tool":"joggai","tool_name":"JoggAI","verdict":"mixed","score":null,"score_total":null,"note":"The export format is correct at full-bleed vertical 9:16 (1080×1920), but the clip is only 15.8 seconds long, below the requested 20–30 second range.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/e89c670ea92e4e40898a885cc3a6f2bf.mp4?v=1","evidence_url":"https://aidemos.com/evidence/4ad029eb-e232-40e8-96d6-dd77cd955d68"},{"id":"12843bee-da2d-4eba-8abd-7b166eae5efd","tool":"synthesia","tool_name":"Synthesia","verdict":"failed","score":null,"score_total":null,"note":"The Nike output was generated in landscape rather than the requested vertical 9:16 short-form format.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/784f543256db468ca9c6cc7080df3a5d.mp4?v=1","evidence_url":"https://aidemos.com/evidence/12843bee-da2d-4eba-8abd-7b166eae5efd"}],"other_criteria":[{"id":"0ed5772b-3529-446f-9085-4e2a3be0eb26","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Nike output keeps a consistent, natural-looking on-camera presenter with stable identity and wardrobe, and the report says the avatar rendering holds up well throughout the clip.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/0ed5772b-3529-446f-9085-4e2a3be0eb26"},{"id":"a2591592-a3fd-4739-b962-a7158f5c1f3f","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The Nike output includes relevant running lifestyle b-roll, but one outdoor running shot contains a visible semi-transparent smear/compositing glitch on the runner's leg.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a2591592-a3fd-4739-b962-a7158f5c1f3f"},{"id":"9d549e62-2e55-4a01-9969-3063ac3d3c06","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The video integrates relevant product close-ups and running lifestyle footage, with a correctly rendered Nike swoosh, 'PEGASUS 41' label, and 'ZOOM' branding in the shoe shot.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/9d549e62-2e55-4a01-9969-3063ac3d3c06"},{"id":"e75de6e5-97b8-48d2-90f8-c5683380af19","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Captions run throughout the Nike clip, and the output shows subtitles advancing with the spoken lines instead of disappearing mid-video.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/e75de6e5-97b8-48d2-90f8-c5683380af19"},{"id":"64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"It understands the product well enough to surface the correct Pegasus 41 branding and real Nike tech claims such as ReactX foam, +13% energy return, and Dual Zoom Air.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4"},{"id":"9293a2e8-227a-4050-bbd3-8c4e25b9c2a4","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The tool assembles a persuasive ad structure with a hook, product B-roll, feature overlays, and a CTA end card, but it rewrites the supplied copy by adding technical claims that were not in the prompt.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/9293a2e8-227a-4050-bbd3-8c4e25b9c2a4"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"4ad029eb-e232-40e8-96d6-dd77cd955d68","tool":"joggai","tool_name":"JoggAI","verdict":"mixed","score":null,"score_total":null,"note":"The export format is correct at full-bleed vertical 9:16 (1080×1920), but the clip is only 15.8 seconds long, below the requested 20–30 second range."},{"id":"12843bee-da2d-4eba-8abd-7b166eae5efd","tool":"synthesia","tool_name":"Synthesia","verdict":"failed","score":null,"score_total":null,"note":"The Nike output was generated in landscape rather than the requested vertical 9:16 short-form format."}]}