{"observation":{"id":"da2f1936-7ceb-4c48-8faf-2e89a917497c","tool":"invideo-ai","tool_name":"Invideo AI","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","criterion_definition":"Relevant supporting footage or product shots, when the tool offers them.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Relevant product shots and supporting footage help determine whether the ad feels complete and convincing. (3 of 3 judges)","scenario":"futuresmart-ai-saas","scenario_name":"FutureSmart AI – SaaS","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC ad prompt for a SaaS product discovery/comparison platform, designed to test whether the tool understands a software product, writes a believable testimonial-style script, and produces a realistic AI presenter video with captions.","modality":"mixed","input_text":"Product URL: https://aidemos.com/\n\nExact script:\nHook: Finding the right AI tools shouldn't take hours.\nScript: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["SaaS product understanding","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"failed","score":null,"score_total":null,"note":"The output contains no cutaways or B-roll at all; it stays a single unbroken shot from start to cutoff.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/d169000cc49a44a58f49e5002ca938b0.png?v=1","role":"context","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://aidemos.com/\n\nExact script:\nHook: Finding the right AI tools shouldn't take hours.\nScript: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["SaaS product understanding","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"invideo-ai","tool_url":"https://aidemos.com/tools/invideo-ai","permalink":"https://aidemos.com/evidence/da2f1936-7ceb-4c48-8faf-2e89a917497c","api_url":"https://ai.aidemos.com/v1/observations/da2f1936-7ceb-4c48-8faf-2e89a917497c"},"peers":[{"id":"a0017b15-66ed-4768-aa31-076de6897d7f","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can keep the ad as one unbroken static talking-head shot, with no product screenshot, cutaway, or other supporting footage to integrate the SaaS visually.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/e2479f4eefeb463ba33c50f244fd2be0.png?v=1","evidence_url":"https://aidemos.com/evidence/a0017b15-66ed-4768-aa31-076de6897d7f"},{"id":"12b2e64a-916d-4f23-9d39-f322cb81774d","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The output stays on a single talking-head studio shot with no product footage, screenshots, or other supporting visuals, so product integration is absent.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/57a22e612d4b431391560092245658e8.mp4?v=1","evidence_url":"https://aidemos.com/evidence/12b2e64a-916d-4f23-9d39-f322cb81774d"}],"other_criteria":[{"id":"efd15dbc-08a8-41a8-91d8-0386e7e60c0c","criterion":"ad-readiness","criterion_name":"Ad-readiness","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"A 17.4-second one-shot clip that ends mid-sentence and never adds an outro, CTA, or product visuals is not shippable as a paid ad.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/efd15dbc-08a8-41a8-91d8-0386e7e60c0c"},{"id":"cd120e81-2ff0-4549-bcd0-8401cb620246","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The presenter reads as a believable human talking head, with natural blinking and clean hand rendering reported across the render and no flicker or warping noted.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/cd120e81-2ff0-4549-bcd0-8401cb620246"},{"id":"76ebc2a2-bd46-412f-80d2-5961502f50f6","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The captions advance progressively and stay readable, and the report says they are well-timed to speech up to the cutoff.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/76ebc2a2-bd46-412f-80d2-5961502f50f6"},{"id":"853d3a38-fafc-4d8a-891a-c96aeb508a8b","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The render never surfaces any product UI, branding, or screenshot for the SaaS, so the product is not visually grounded beyond a generic talking-head testimonial.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/853d3a38-fafc-4d8a-891a-c96aeb508a8b"},{"id":"60e772f6-15a5-4cfb-a091-1785ebaaf649","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The script stays faithful and the hook/value proposition come through, but the CTA never lands because the render stops mid-sentence at \"worth\" instead of finishing the closing line.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/60e772f6-15a5-4cfb-a091-1785ebaaf649"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"a0017b15-66ed-4768-aa31-076de6897d7f","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can keep the ad as one unbroken static talking-head shot, with no product screenshot, cutaway, or other supporting footage to integrate the SaaS visually."},{"id":"12b2e64a-916d-4f23-9d39-f322cb81774d","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The output stays on a single talking-head studio shot with no product footage, screenshots, or other supporting visuals, so product integration is absent."}]}