{"observation":{"id":"c25c8cdf-0d93-46a1-a835-4cc0824146f1","tool":"animg","tool_name":"AnimG","criterion":"output-quality","criterion_name":"Output Quality","criterion_definition":"Conceptually matches the prompt and is visually usable.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"The tool is being chosen to produce usable code-based animations, so conceptual match to the prompt and visual usability are core success criteria. (3 of 3 judges)","scenario":"search-engines-basics-explainer","scenario_name":"Search engines basics explainer","group_tag":null,"scenario_description":"A vague, linear educational animation prompt asking the tool to explain how search engines work with minimal guidance. Designed to stress inference, scene structuring, pacing, and coherent visual flow from an underspecified request.","modality":"text","input_text":"Create an animation video explaining how search engines work.","input_artifact_refs":[],"stresses":[],"verdict":"mixed","score":null,"score_total":null,"note":"For the low-complexity search-engine explainer, the animation stays conceptually aligned with crawling, indexing, ranking, and results display, but the visuals are basic, flat, and show minor overlap or clutter.","evidence_state":"verified","source":"first-party","artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/animg-20260419-090730-searchengineworkflow.mp4","role":"output","alt":"AnimG — 20260419_090730_SearchEngineWorkflow.mp4"}],"run_id":"c751a76b-a105-4b3e-9ff3-6c4d6adc9f04","study_title":"Generate Code-based Animations from text inputs","study_kind":"backfill","research_task":"86b9nnzmy","tested_at":"2026-06-24T08:34:34.142000+00:00","completeness":"input-and-output","input":{"state":"text","text":"Create an animation video explaining how search engines work.","files":[],"modality":"text","stresses":[]},"tool_page_slug":"animg","tool_url":"https://aidemos.com/tools/animg","permalink":"https://aidemos.com/evidence/c25c8cdf-0d93-46a1-a835-4cc0824146f1","api_url":"https://ai.aidemos.com/v1/observations/c25c8cdf-0d93-46a1-a835-4cc0824146f1"},"peers":[{"id":"bae09520-6cfa-40cc-a95e-776d599142a6","tool":"antigravity","tool_name":"Antigravity","verdict":"worked","score":null,"score_total":null,"note":"Produces a visually readable 15-second explainer that presents crawling, indexing, ranking, and serving in sequence.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/antigravity-output.mp4","evidence_url":"https://aidemos.com/evidence/bae09520-6cfa-40cc-a95e-776d599142a6"},{"id":"cdfe3d65-164a-4c24-a556-0d75b593be5c","tool":"chatgpt-canvas","tool_name":"ChatGPT Canvas","verdict":"mixed","score":null,"score_total":null,"note":"Can match the requested topic, but the first-pass visual output is only a plain horizontal flowchart with text-only nodes, overflowing labels, and no icons or hierarchy, so it is not visually polished.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/chatgpt-canvas-screen-recording-2026-04-30-170046.mp4","evidence_url":"https://aidemos.com/evidence/cdfe3d65-164a-4c24-a556-0d75b593be5c"},{"id":"2d00ddc3-5c2f-4e48-ab54-e9b6cdfb2ac0","tool":"claude-artifacts","tool_name":"Claude Artifacts","verdict":"worked","score":null,"score_total":null,"note":"Delivered a polished animation with smooth motion, clean hierarchy, and a recognizable search-engine workflow.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/claude-artifacts-screen-recording-2026-04-30-141425.mp4","evidence_url":"https://aidemos.com/evidence/2d00ddc3-5c2f-4e48-ab54-e9b6cdfb2ac0"},{"id":"a131ca60-0b5b-498d-af60-7d27a5ff8b29","tool":"gemini-canvas","tool_name":"Gemini Canvas","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the animation inside a macOS-style tab frame with a very small aspect ratio, which makes the result feel presentation-like rather than like a full motion-graphics video.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-canvas-screen-recording-2026-05-04-120930.mp4","evidence_url":"https://aidemos.com/evidence/a131ca60-0b5b-498d-af60-7d27a5ff8b29"},{"id":"e8505de0-5cac-48fb-811d-29a4753d36b6","tool":"grok","tool_name":"Grok","verdict":"failed","score":null,"score_total":null,"note":"Produces output that reads more like an interactive webpage than a video-like animation, with cramped spacing, overlapping elements, weak visual hierarchy, and visible controls.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/grok-screen-recording-2026-05-04-135441.mp4","evidence_url":"https://aidemos.com/evidence/e8505de0-5cac-48fb-811d-29a4753d36b6"},{"id":"0da2a252-41c7-4636-bdfb-32bc3df40e96","tool":"remotionvideo","tool_name":"RemotionVideo","verdict":"worked","score":null,"score_total":null,"note":"Produces a clean, polished explainer that visually communicates a 3-step crawl → index → rank flow with no overlap or layout clutter.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/remotionvideo-589f02b7-33c6-43cd-9d90-262a33680d94.mp4","evidence_url":"https://aidemos.com/evidence/0da2a252-41c7-4636-bdfb-32bc3df40e96"},{"id":"31d4ba1b-655a-4062-ae44-4c5622c0e687","tool":"replit","tool_name":"Replit","verdict":"worked","score":null,"score_total":null,"note":"Delivers clean motion graphics with clear sequencing and visual hierarchy, making the explanation immediately understandable.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/replit-search-engine-explainer-apr-18-15-53-35.mp4","evidence_url":"https://aidemos.com/evidence/31d4ba1b-655a-4062-ae44-4c5622c0e687"}],"other_criteria":[{"id":"7062524a-d54a-4a4c-98b2-dd205aff10bb","criterion":"code-generation-quality","criterion_name":"Code Generation Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generates syntactically correct Manim code on the first pass.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/7062524a-d54a-4a4c-98b2-dd205aff10bb"},{"id":"247742ce-3f3d-47dd-abb9-916629f5f2e3","criterion":"export-experience","criterion_name":"Export Experience","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"Finishes by producing an MP4 inside the web app and surfacing the result in a built-in video player, so getting the rendered video is straightforward.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/247742ce-3f3d-47dd-abb9-916629f5f2e3"},{"id":"7f627ba6-a234-47e0-96e6-0f853a5509dd","criterion":"export-experience","criterion_name":"Export Experience","rank_role":"context","verdict":"mixed","score":null,"score_total":null,"note":"Getting an MP4 is straightforward, but the free output is watermarked and the UI prompts an upgrade for watermark-free export.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/7f627ba6-a234-47e0-96e6-0f853a5509dd"}],"appears_in":[{"page_type":"ranking","slug":"code-animation-generators","title":"Best AI Tools for Generating Code-Based Animations from Text Prompts","url":"https://aidemos.com/best/code-animation-generators","binding":"run"},{"page_type":"use-case","slug":"generate-code-animation-videos","title":"Generate Code-Based Animation Videos from Text Prompts Using AI","url":"https://aidemos.com/use-cases/generate-code-animation-videos","binding":"run"}],"same_scenario":[{"id":"bae09520-6cfa-40cc-a95e-776d599142a6","tool":"antigravity","tool_name":"Antigravity","verdict":"worked","score":null,"score_total":null,"note":"Produces a visually readable 15-second explainer that presents crawling, indexing, ranking, and serving in sequence."},{"id":"cdfe3d65-164a-4c24-a556-0d75b593be5c","tool":"chatgpt-canvas","tool_name":"ChatGPT Canvas","verdict":"mixed","score":null,"score_total":null,"note":"Can match the requested topic, but the first-pass visual output is only a plain horizontal flowchart with text-only nodes, overflowing labels, and no icons or hierarchy, so it is not visually polished."},{"id":"2d00ddc3-5c2f-4e48-ab54-e9b6cdfb2ac0","tool":"claude-artifacts","tool_name":"Claude Artifacts","verdict":"worked","score":null,"score_total":null,"note":"Delivered a polished animation with smooth motion, clean hierarchy, and a recognizable search-engine workflow."},{"id":"a131ca60-0b5b-498d-af60-7d27a5ff8b29","tool":"gemini-canvas","tool_name":"Gemini Canvas","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the animation inside a macOS-style tab frame with a very small aspect ratio, which makes the result feel presentation-like rather than like a full motion-graphics video."},{"id":"e8505de0-5cac-48fb-811d-29a4753d36b6","tool":"grok","tool_name":"Grok","verdict":"failed","score":null,"score_total":null,"note":"Produces output that reads more like an interactive webpage than a video-like animation, with cramped spacing, overlapping elements, weak visual hierarchy, and visible controls."},{"id":"0da2a252-41c7-4636-bdfb-32bc3df40e96","tool":"remotionvideo","tool_name":"RemotionVideo","verdict":"worked","score":null,"score_total":null,"note":"Produces a clean, polished explainer that visually communicates a 3-step crawl → index → rank flow with no overlap or layout clutter."},{"id":"31d4ba1b-655a-4062-ae44-4c5622c0e687","tool":"replit","tool_name":"Replit","verdict":"worked","score":null,"score_total":null,"note":"Delivers clean motion graphics with clear sequencing and visual hierarchy, making the explanation immediately understandable."}]}