{"observation":{"id":"a0017b15-66ed-4768-aa31-076de6897d7f","tool":"joggai","tool_name":"JoggAI","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","criterion_definition":"Relevant supporting footage or product shots, when the tool offers them.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Relevant product shots and supporting footage help determine whether the ad feels complete and convincing. (3 of 3 judges)","scenario":"futuresmart-ai-saas","scenario_name":"FutureSmart AI – SaaS","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC ad prompt for a SaaS product discovery/comparison platform, designed to test whether the tool understands a software product, writes a believable testimonial-style script, and produces a realistic AI presenter video with captions.","modality":"mixed","input_text":"Product URL: https://aidemos.com/\n\nExact script:\nHook: Finding the right AI tools shouldn't take hours.\nScript: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["SaaS product understanding","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"failed","score":null,"score_total":null,"note":"The tool can keep the ad as one unbroken static talking-head shot, with no product screenshot, cutaway, or other supporting footage to integrate the SaaS visually.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/e2479f4eefeb463ba33c50f244fd2be0.png?v=1","role":"output","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://aidemos.com/\n\nExact script:\nHook: Finding the right AI tools shouldn't take hours.\nScript: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["SaaS product understanding","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"joggai","tool_url":"https://aidemos.com/tools/joggai","permalink":"https://aidemos.com/evidence/a0017b15-66ed-4768-aa31-076de6897d7f","api_url":"https://ai.aidemos.com/v1/observations/a0017b15-66ed-4768-aa31-076de6897d7f"},"peers":[{"id":"da2f1936-7ceb-4c48-8faf-2e89a917497c","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"failed","score":null,"score_total":null,"note":"The output contains no cutaways or B-roll at all; it stays a single unbroken shot from start to cutoff.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/d169000cc49a44a58f49e5002ca938b0.png?v=1","evidence_url":"https://aidemos.com/evidence/da2f1936-7ceb-4c48-8faf-2e89a917497c"},{"id":"12b2e64a-916d-4f23-9d39-f322cb81774d","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The output stays on a single talking-head studio shot with no product footage, screenshots, or other supporting visuals, so product integration is absent.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/57a22e612d4b431391560092245658e8.mp4?v=1","evidence_url":"https://aidemos.com/evidence/12b2e64a-916d-4f23-9d39-f322cb81774d"}],"other_criteria":[{"id":"3c44a1fd-97ee-4a28-a9d1-45ad62796d1b","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generates a convincing photorealistic talking-head avatar, with the report noting natural skin, hair, teeth, expressive gesturing, and no visible deformities or robotic feel.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/3c44a1fd-97ee-4a28-a9d1-45ad62796d1b"},{"id":"424476ea-567e-4aaa-b6ff-6169563824b0","criterion":"caption-quality","criterion_name":"Caption quality","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 18.4 seconds, so captioning is not baked into the output.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/424476ea-567e-4aaa-b6ff-6169563824b0"},{"id":"69db4d2f-5b9b-4753-8f89-173a86326bf0","criterion":"platform-formats","criterion_name":"Platform formats","rank_role":"context","verdict":"mixed","score":null,"score_total":null,"note":"The export format is correct at full-bleed vertical 9:16 (1080×1920), but the clip is only 18.4 seconds long, below the requested 20–30 second range.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/69db4d2f-5b9b-4753-8f89-173a86326bf0"},{"id":"0bf6b441-c1cc-457b-b234-6838553eac34","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"For a SaaS-discovery prompt, the tool can misread the product context by choosing a generic classroom/math-teacher template instead of a relevant tech-review persona, signaling weak product mapping.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/0bf6b441-c1cc-457b-b234-6838553eac34"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"da2f1936-7ceb-4c48-8faf-2e89a917497c","tool":"invideo-ai","tool_name":"Invideo AI","verdict":"failed","score":null,"score_total":null,"note":"The output contains no cutaways or B-roll at all; it stays a single unbroken shot from start to cutoff."},{"id":"12b2e64a-916d-4f23-9d39-f322cb81774d","tool":"topview-ai","tool_name":"Topview AI","verdict":"struggled","score":null,"score_total":null,"note":"The output stays on a single talking-head studio shot with no product footage, screenshots, or other supporting visuals, so product integration is absent."}]}