{"observation":{"id":"64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4","tool":"heygen","tool_name":"HeyGen","criterion":"product-understanding","criterion_name":"Product understanding","criterion_definition":"Whether the tool gets the product right in features and positioning, rather than being generic or inaccurate.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"An ad has to describe the product accurately and position it correctly; generic or wrong messaging breaks the output. (3 of 3 judges)","scenario":"nike-pegasus-41-physical-product","scenario_name":"Nike Pegasus 41 – Physical Product","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC testimonial prompt for a physical consumer product, designed to test product comprehension, believable praise for a running shoe, and ad-style video generation quality.","modality":"mixed","input_text":"Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002\n\nExact script:\nHook: These are my new favorite running shoes.\nScript: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["Physical product understanding","UGC testimonial quality","Product presentation","Avatar realism","Voice quality","Commercial ad readiness"],"verdict":"worked","score":null,"score_total":null,"note":"It understands the product well enough to surface the correct Pegasus 41 branding and real Nike tech claims such as ReactX foam, +13% energy return, and Dual Zoom Air.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/77f0599bfa52427a99725c88fb03c98f.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/3dd0fc6846bd43c8bf53a34d3b6fef3f.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/3972776f54954f51a8880acdf7c95556.png?v=1","role":"context","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://www.nike.com/t/pegasus-41-mens-road-running-shoes-LMhrRG/FD2722-002\n\nExact script:\nHook: These are my new favorite running shoes.\nScript: I've been wearing the Nike Pegasus 41 for my daily runs, and they've been incredibly comfortable from day one. They're lightweight, well-cushioned, and great for everyday training. If you're looking for dependable running shoes, they're definitely worth considering.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["Physical product understanding","UGC testimonial quality","Product presentation","Avatar realism","Voice quality","Commercial ad readiness"]},"tool_page_slug":"heygen","tool_url":"https://aidemos.com/tools/heygen","permalink":"https://aidemos.com/evidence/64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4","api_url":"https://ai.aidemos.com/v1/observations/64a46e2f-ab7d-46d6-9ff8-15c6ed03a7b4"},"peers":[{"id":"20c94d4e-a350-4051-aade-4bb7aecccce2","tool":"akool","tool_name":"AKOOL","verdict":"worked","score":null,"score_total":null,"note":"Keeps the running-shoe testimonial in the right product-review framing, so the product positioning is recognizable even though the visuals stay restrained.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/c819bfc8aa064bbf850fd8a79f6ddd7e.mp4?v=1","evidence_url":"https://aidemos.com/evidence/20c94d4e-a350-4051-aade-4bb7aecccce2"},{"id":"745d6efc-d83e-4c04-8258-ef302a0402ec","tool":"creatify-ai","tool_name":"Creatify.ai","verdict":"worked","score":null,"score_total":null,"note":"For the shoe input, the tool kept the testimonial centered on running-shoe benefits such as comfort, lightweight feel, cushioning, and everyday training use.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a2730beb64da44b99facf2644c6e5ed1.mp4?v=1","evidence_url":"https://aidemos.com/evidence/745d6efc-d83e-4c04-8258-ef302a0402ec"},{"id":"9b3a4a97-0ec3-40c7-a97d-c5855cd4a01c","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"worked","score":null,"score_total":null,"note":"The tool correctly renders a gray Nike Pegasus shoe with the swoosh, colorway, and AIR ZOOM sole detail, matching the product prompt instead of generic running shoes.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/dc64594449d3425abe47654218566644.mp4?v=1","evidence_url":"https://aidemos.com/evidence/9b3a4a97-0ec3-40c7-a97d-c5855cd4a01c"},{"id":"ff954838-bdca-4954-ad0d-bc1db6a3cb88","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"For a physical-product prompt, the tool can omit the product entirely and keep the ad grounded only in a face-only testimonial shot, so the product itself is never actually integrated.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a6a80555444b433e8edc346853fb7b07.png?v=1","evidence_url":"https://aidemos.com/evidence/ff954838-bdca-4954-ad0d-bc1db6a3cb88"},{"id":"2db9d7c2-5ddd-495b-95b2-99c350448da6","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"worked","score":null,"score_total":null,"note":"Understands a running-shoe product well enough to position it as comfortable, lightweight, well-cushioned, and suitable for everyday training.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/3547906864bf4cbd804ba34ccb08c8c5.mp4?v=1","evidence_url":"https://aidemos.com/evidence/2db9d7c2-5ddd-495b-95b2-99c350448da6"}],"other_criteria":[{"id":"0ed5772b-3529-446f-9085-4e2a3be0eb26","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Nike output keeps a consistent, natural-looking on-camera presenter with stable identity and wardrobe, and the report says the avatar rendering holds up well throughout the clip.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/0ed5772b-3529-446f-9085-4e2a3be0eb26"},{"id":"a2591592-a3fd-4739-b962-a7158f5c1f3f","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The Nike output includes relevant running lifestyle b-roll, but one outdoor running shot contains a visible semi-transparent smear/compositing glitch on the runner's leg.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a2591592-a3fd-4739-b962-a7158f5c1f3f"},{"id":"9d549e62-2e55-4a01-9969-3063ac3d3c06","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The video integrates relevant product close-ups and running lifestyle footage, with a correctly rendered Nike swoosh, 'PEGASUS 41' label, and 'ZOOM' branding in the shoe shot.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/9d549e62-2e55-4a01-9969-3063ac3d3c06"},{"id":"e75de6e5-97b8-48d2-90f8-c5683380af19","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Captions run throughout the Nike clip, and the output shows subtitles advancing with the spoken lines instead of disappearing mid-video.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/e75de6e5-97b8-48d2-90f8-c5683380af19"},{"id":"c011acaf-5710-42f7-9d0e-19d55611c585","criterion":"platform-formats","criterion_name":"Platform formats","rank_role":"context","verdict":"failed","score":null,"score_total":null,"note":"The export comes out as a 1920x1080 widescreen video, not the requested vertical 9:16 UGC format for TikTok/Reels/Shorts.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/c011acaf-5710-42f7-9d0e-19d55611c585"},{"id":"9293a2e8-227a-4050-bbd3-8c4e25b9c2a4","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The tool assembles a persuasive ad structure with a hook, product B-roll, feature overlays, and a CTA end card, but it rewrites the supplied copy by adding technical claims that were not in the prompt.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/9293a2e8-227a-4050-bbd3-8c4e25b9c2a4"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"20c94d4e-a350-4051-aade-4bb7aecccce2","tool":"akool","tool_name":"AKOOL","verdict":"worked","score":null,"score_total":null,"note":"Keeps the running-shoe testimonial in the right product-review framing, so the product positioning is recognizable even though the visuals stay restrained."},{"id":"745d6efc-d83e-4c04-8258-ef302a0402ec","tool":"creatify-ai","tool_name":"Creatify.ai","verdict":"worked","score":null,"score_total":null,"note":"For the shoe input, the tool kept the testimonial centered on running-shoe benefits such as comfort, lightweight feel, cushioning, and everyday training use."},{"id":"9b3a4a97-0ec3-40c7-a97d-c5855cd4a01c","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"worked","score":null,"score_total":null,"note":"The tool correctly renders a gray Nike Pegasus shoe with the swoosh, colorway, and AIR ZOOM sole detail, matching the product prompt instead of generic running shoes."},{"id":"ff954838-bdca-4954-ad0d-bc1db6a3cb88","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"For a physical-product prompt, the tool can omit the product entirely and keep the ad grounded only in a face-only testimonial shot, so the product itself is never actually integrated."},{"id":"2db9d7c2-5ddd-495b-95b2-99c350448da6","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"worked","score":null,"score_total":null,"note":"Understands a running-shoe product well enough to position it as comfortable, lightweight, well-cushioned, and suitable for everyday training."}]}