{"observation":{"id":"76ebc2a2-bd46-412f-80d2-5961502f50f6","tool":"invideo-ai","tool_name":"Invideo AI","criterion":"caption-quality","criterion_name":"Caption quality","criterion_definition":"Accurate, well-timed captions with appropriate, on-trend styling.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Accurate, well-timed captions are part of the finished ad and affect clarity and performance on social platforms. (3 of 3 judges)","scenario":"futuresmart-ai-saas","scenario_name":"FutureSmart AI – SaaS","group_tag":"ugc-style-video-ads","scenario_description":"A short-form UGC ad prompt for a SaaS product discovery/comparison platform, designed to test whether the tool understands a software product, writes a believable testimonial-style script, and produces a realistic AI presenter video with captions.","modality":"mixed","input_text":"Product URL: https://aidemos.com/\n\nExact script:\nHook: Finding the right AI tools shouldn't take hours.\nScript: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","input_artifact_refs":[],"stresses":["SaaS product understanding","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"],"verdict":"worked","score":null,"score_total":null,"note":"The captions advance progressively and stay readable, and the report says they are well-timed to speech up to the cutoff.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/093d24dd0ea0430eb36a89eeea1d9e3a.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/924caf452b214eada4bb567936726d27.png?v=1","role":"context","alt":null}],"run_id":"9fdbb84b-4aa0-484d-8f89-5c46608019a5","study_title":"Generate UGC-Style Video Ads With AI Avatars","study_kind":"generation","research_task":"86baxegpg","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Product URL: https://aidemos.com/\n\nExact script:\nHook: Finding the right AI tools shouldn't take hours.\nScript: I've been using FutureSmart AI to discover and compare AI tools in one place. It helps me find the right tool faster with real use cases, rankings, and detailed comparisons. If you regularly use AI tools for work, it's definitely worth checking out.\n\nOutput requirements:\n- Vertical (9:16)\n- 20–30 seconds\n- UGC-style AI presenter\n- Natural AI voice\n- Captions enabled","files":[],"modality":"mixed","stresses":["SaaS product understanding","Script quality","Avatar realism","Voice quality","Caption quality","Overall ad readiness"]},"tool_page_slug":"invideo-ai","tool_url":"https://aidemos.com/tools/invideo-ai","permalink":"https://aidemos.com/evidence/76ebc2a2-bd46-412f-80d2-5961502f50f6","api_url":"https://ai.aidemos.com/v1/observations/76ebc2a2-bd46-412f-80d2-5961502f50f6"},"peers":[{"id":"29955053-f01f-44fd-90a0-99638f276f7f","tool":"akool","tool_name":"AKOOL","verdict":"failed","score":null,"score_total":null,"note":"Does not automatically include captions in the initial output; the preview showed no captions during the tested workflow.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/e6207ee421ef47c2b87698e799385f05.png?v=1","evidence_url":"https://aidemos.com/evidence/29955053-f01f-44fd-90a0-99638f276f7f"},{"id":"fc836d16-388e-4ee4-bec0-cb53fc29b6f0","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"Captioning is absent in the FutureSmart run: the researcher checked 8 timestamps from 0s through 14.9s and found zero burned-in text anywhere in the clip.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/71bfe9794b8d47ff8fe33c606ad1bf35.png?v=1","evidence_url":"https://aidemos.com/evidence/fc836d16-388e-4ee4-bec0-cb53fc29b6f0"},{"id":"424476ea-567e-4aaa-b6ff-6169563824b0","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 18.4 seconds, so captioning is not baked into the output.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/e2479f4eefeb463ba33c50f244fd2be0.png?v=1","evidence_url":"https://aidemos.com/evidence/424476ea-567e-4aaa-b6ff-6169563824b0"},{"id":"f52e38cf-6d84-4ef5-a6e0-428548537f6a","tool":"topview-ai","tool_name":"Topview AI","verdict":"mixed","score":null,"score_total":null,"note":"Captions were generated and generally aligned with speech, but the run had minor timing issues.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/57a22e612d4b431391560092245658e8.mp4?v=1","evidence_url":"https://aidemos.com/evidence/f52e38cf-6d84-4ef5-a6e0-428548537f6a"},{"id":"76b72ebd-55b4-429f-8a68-9216fd07beca","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"mixed","score":null,"score_total":null,"note":"Can generate burned-in subtitles and lets the user edit them after creation, but the caption text can be awkward—the preview shows a duplicated opening phrase, 'Welcome to FutureSmart AI AI to discover'.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/381414c80276434dbf78da871dde6d38.png?v=1","evidence_url":"https://aidemos.com/evidence/76b72ebd-55b4-429f-8a68-9216fd07beca"}],"other_criteria":[{"id":"efd15dbc-08a8-41a8-91d8-0386e7e60c0c","criterion":"ad-readiness","criterion_name":"Ad-readiness","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"A 17.4-second one-shot clip that ends mid-sentence and never adds an outro, CTA, or product visuals is not shippable as a paid ad.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/efd15dbc-08a8-41a8-91d8-0386e7e60c0c"},{"id":"cd120e81-2ff0-4549-bcd0-8401cb620246","criterion":"avatar-realism","criterion_name":"Avatar realism","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The presenter reads as a believable human talking head, with natural blinking and clean hand rendering reported across the render and no flicker or warping noted.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/cd120e81-2ff0-4549-bcd0-8401cb620246"},{"id":"da2f1936-7ceb-4c48-8faf-2e89a917497c","criterion":"b-roll-product-integration","criterion_name":"B-roll / product integration","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The output contains no cutaways or B-roll at all; it stays a single unbroken shot from start to cutoff.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/da2f1936-7ceb-4c48-8faf-2e89a917497c"},{"id":"853d3a38-fafc-4d8a-891a-c96aeb508a8b","criterion":"product-understanding","criterion_name":"Product understanding","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The render never surfaces any product UI, branding, or screenshot for the SaaS, so the product is not visually grounded beyond a generic talking-head testimonial.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/853d3a38-fafc-4d8a-891a-c96aeb508a8b"},{"id":"60e772f6-15a5-4cfb-a091-1785ebaaf649","criterion":"script-quality-persuasiveness","criterion_name":"Script quality & persuasiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The script stays faithful and the hook/value proposition come through, but the CTA never lands because the render stops mid-sentence at \"worth\" instead of finishing the closing line.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/60e772f6-15a5-4cfb-a091-1785ebaaf649"}],"appears_in":[{"page_type":"ranking","slug":"ugc-video-ad-generators","title":"Best AI Tools for Generating UGC-Style Video Ads With AI Avatars","url":"https://aidemos.com/best/ugc-video-ad-generators","binding":"run"}],"same_scenario":[{"id":"29955053-f01f-44fd-90a0-99638f276f7f","tool":"akool","tool_name":"AKOOL","verdict":"failed","score":null,"score_total":null,"note":"Does not automatically include captions in the initial output; the preview showed no captions during the tested workflow."},{"id":"fc836d16-388e-4ee4-bec0-cb53fc29b6f0","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"Captioning is absent in the FutureSmart run: the researcher checked 8 timestamps from 0s through 14.9s and found zero burned-in text anywhere in the clip."},{"id":"424476ea-567e-4aaa-b6ff-6169563824b0","tool":"joggai","tool_name":"JoggAI","verdict":"failed","score":null,"score_total":null,"note":"The tool can export a clip with zero on-screen captions for the full 18.4 seconds, so captioning is not baked into the output."},{"id":"f52e38cf-6d84-4ef5-a6e0-428548537f6a","tool":"topview-ai","tool_name":"Topview AI","verdict":"mixed","score":null,"score_total":null,"note":"Captions were generated and generally aligned with speech, but the run had minor timing issues."},{"id":"76b72ebd-55b4-429f-8a68-9216fd07beca","tool":"vidnoz-ai","tool_name":"Vidnoz AI","verdict":"mixed","score":null,"score_total":null,"note":"Can generate burned-in subtitles and lets the user edit them after creation, but the caption text can be awkward—the preview shows a duplicated opening phrase, 'Welcome to FutureSmart AI AI to discover'."}]}