{"observation":{"id":"cdfe3d65-164a-4c24-a556-0d75b593be5c","tool":"chatgpt-canvas","tool_name":"ChatGPT Canvas","criterion":"output-quality","criterion_name":"Output Quality","criterion_definition":"Conceptually matches the prompt and is visually usable.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"The tool is being chosen to produce usable code-based animations, so conceptual match to the prompt and visual usability are core success criteria. (3 of 3 judges)","scenario":"search-engines-basics-explainer","scenario_name":"Search engines basics explainer","group_tag":null,"scenario_description":"A vague, linear educational animation prompt asking the tool to explain how search engines work with minimal guidance. Designed to stress inference, scene structuring, pacing, and coherent visual flow from an underspecified request.","modality":"text","input_text":"Create an animation video explaining how search engines work.","input_artifact_refs":[],"stresses":[],"verdict":"mixed","score":null,"score_total":null,"note":"Can match the requested topic, but the first-pass visual output is only a plain horizontal flowchart with text-only nodes, overflowing labels, and no icons or hierarchy, so it is not visually polished.","evidence_state":"observed","source":"first-party","artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/chatgpt-canvas-screen-recording-2026-04-30-170046.mp4","role":"context","alt":"ChatGPT Canvas — Screen Recording 2026-04-30 170046.mp4"}],"run_id":"c751a76b-a105-4b3e-9ff3-6c4d6adc9f04","study_title":"Generate Code-based Animations from text inputs","study_kind":"backfill","research_task":"86b9nnzmy","tested_at":"2026-06-24T08:34:34.142000+00:00","completeness":"input-and-output","input":{"state":"text","text":"Create an animation video explaining how search engines work.","files":[],"modality":"text","stresses":[]},"tool_page_slug":null,"tool_url":null,"permalink":"https://aidemos.com/evidence/cdfe3d65-164a-4c24-a556-0d75b593be5c","api_url":"https://ai.aidemos.com/v1/observations/cdfe3d65-164a-4c24-a556-0d75b593be5c"},"peers":[{"id":"a76fdadf-bd9a-450a-8c96-3b05cb38cb69","tool":"animg","tool_name":"AnimG","verdict":"struggled","score":null,"score_total":null,"note":"At moderate diagram complexity, the tool still matches the concept, but overlapping labels, arrows, and components make the render hard to follow.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/a76fdadf-bd9a-450a-8c96-3b05cb38cb69"},{"id":"bae09520-6cfa-40cc-a95e-776d599142a6","tool":"antigravity","tool_name":"Antigravity","verdict":"worked","score":null,"score_total":null,"note":"Produces a visually readable 15-second explainer that presents crawling, indexing, ranking, and serving in sequence.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/antigravity-output.mp4","evidence_url":"https://aidemos.com/evidence/bae09520-6cfa-40cc-a95e-776d599142a6"},{"id":"2d00ddc3-5c2f-4e48-ab54-e9b6cdfb2ac0","tool":"claude-artifacts","tool_name":"Claude Artifacts","verdict":"worked","score":null,"score_total":null,"note":"Delivered a polished animation with smooth motion, clean hierarchy, and a recognizable search-engine workflow.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/claude-artifacts-screen-recording-2026-04-30-141425.mp4","evidence_url":"https://aidemos.com/evidence/2d00ddc3-5c2f-4e48-ab54-e9b6cdfb2ac0"},{"id":"12a9b2c1-b3be-4562-8a14-87ccf9f4540c","tool":"gemini-canvas","tool_name":"Gemini Canvas","verdict":"worked","score":null,"score_total":null,"note":"It can cover the full search-engine workflow—crawling, indexing, and ranking—without overlap or visual clutter.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/gemini-canvas-gemini-search-engine-animation.mp4","evidence_url":"https://aidemos.com/evidence/12a9b2c1-b3be-4562-8a14-87ccf9f4540c"},{"id":"196fc12d-b1d5-46bc-823b-797983bce1b4","tool":"grok","tool_name":"Grok","verdict":"failed","score":null,"score_total":null,"note":"Produces a cluttered, webpage-like result with overlapping elements, cramped spacing, and no clear motion-graphics hierarchy.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/grok-grok.mp4","evidence_url":"https://aidemos.com/evidence/196fc12d-b1d5-46bc-823b-797983bce1b4"},{"id":"0da2a252-41c7-4636-bdfb-32bc3df40e96","tool":"remotionvideo","tool_name":"RemotionVideo","verdict":"worked","score":null,"score_total":null,"note":"Produces a clean, polished explainer that visually communicates a 3-step crawl → index → rank flow with no overlap or layout clutter.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/remotionvideo-589f02b7-33c6-43cd-9d90-262a33680d94.mp4","evidence_url":"https://aidemos.com/evidence/0da2a252-41c7-4636-bdfb-32bc3df40e96"},{"id":"31d4ba1b-655a-4062-ae44-4c5622c0e687","tool":"replit","tool_name":"Replit","verdict":"worked","score":null,"score_total":null,"note":"Delivers clean motion graphics with clear sequencing and visual hierarchy, making the explanation immediately understandable.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/replit-search-engine-explainer-apr-18-15-53-35.mp4","evidence_url":"https://aidemos.com/evidence/31d4ba1b-655a-4062-ae44-4c5622c0e687"}],"other_criteria":[{"id":"783827be-868d-4058-9a88-b7fda3c34533","criterion":"code-generation-quality","criterion_name":"Code Generation Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generated syntactically correct, runnable HTML/CSS/JavaScript on the first attempt for the search-engine explainer.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/783827be-868d-4058-9a88-b7fda3c34533"},{"id":"8c586228-b763-4fd1-9403-2f83e2b9bcfe","criterion":"code-generation-quality","criterion_name":"Code Generation Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generates syntactically correct HTML/CSS/JavaScript on the first attempt and can produce an auto-playing, continuous-loop animation without user interaction.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/8c586228-b763-4fd1-9403-2f83e2b9bcfe"},{"id":"d60b7cdd-b974-41b0-bec9-1c6a3eee97b0","criterion":"in-platform-preview","criterion_name":"In-Platform Preview","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"Canvas showed the animation immediately on load, with live preview available and the motion running in a continuous loop.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/d60b7cdd-b974-41b0-bec9-1c6a3eee97b0"}],"appears_in":[{"page_type":"ranking","slug":"code-animation-generators","title":"Best AI Tools for Generating Code-Based Animations from Text Prompts","url":"https://aidemos.com/best/code-animation-generators","binding":"run"},{"page_type":"use-case","slug":"generate-code-animation-videos","title":"Generate Code-Based Animation Videos from Text Prompts Using AI","url":"https://aidemos.com/use-cases/generate-code-animation-videos","binding":"run"}],"same_scenario":[{"id":"a76fdadf-bd9a-450a-8c96-3b05cb38cb69","tool":"animg","tool_name":"AnimG","verdict":"struggled","score":null,"score_total":null,"note":"At moderate diagram complexity, the tool still matches the concept, but overlapping labels, arrows, and components make the render hard to follow."},{"id":"bae09520-6cfa-40cc-a95e-776d599142a6","tool":"antigravity","tool_name":"Antigravity","verdict":"worked","score":null,"score_total":null,"note":"Produces a visually readable 15-second explainer that presents crawling, indexing, ranking, and serving in sequence."},{"id":"2d00ddc3-5c2f-4e48-ab54-e9b6cdfb2ac0","tool":"claude-artifacts","tool_name":"Claude Artifacts","verdict":"worked","score":null,"score_total":null,"note":"Delivered a polished animation with smooth motion, clean hierarchy, and a recognizable search-engine workflow."},{"id":"12a9b2c1-b3be-4562-8a14-87ccf9f4540c","tool":"gemini-canvas","tool_name":"Gemini Canvas","verdict":"worked","score":null,"score_total":null,"note":"It can cover the full search-engine workflow—crawling, indexing, and ranking—without overlap or visual clutter."},{"id":"196fc12d-b1d5-46bc-823b-797983bce1b4","tool":"grok","tool_name":"Grok","verdict":"failed","score":null,"score_total":null,"note":"Produces a cluttered, webpage-like result with overlapping elements, cramped spacing, and no clear motion-graphics hierarchy."},{"id":"0da2a252-41c7-4636-bdfb-32bc3df40e96","tool":"remotionvideo","tool_name":"RemotionVideo","verdict":"worked","score":null,"score_total":null,"note":"Produces a clean, polished explainer that visually communicates a 3-step crawl → index → rank flow with no overlap or layout clutter."},{"id":"31d4ba1b-655a-4062-ae44-4c5622c0e687","tool":"replit","tool_name":"Replit","verdict":"worked","score":null,"score_total":null,"note":"Delivers clean motion graphics with clear sequencing and visual hierarchy, making the explanation immediately understandable."}]}