{"observation":{"id":"5184836d-0085-424a-90b0-fa1229ea5980","tool":"akool","tool_name":"Akool","criterion":"translation-accuracy","criterion_name":"Translation Accuracy","criterion_definition":"Is the translated output semantically correct, and does it preserve technical terms, tone, and meaning?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If the translation changes meaning, tone, or technical terms, the tool fails the core job of translating the video. (3 of 3 judges)","scenario":"educational-airport-conversation-short-english-spanish","scenario_name":"Educational airport conversation short (English → Spanish)","group_tag":"video-translation-voice-clone-lip-sync","scenario_description":"A structured educational/conversation-style English short video used to test translation into Spanish with clear narration, steadier pacing, and easier lip-sync alignment than the other scenarios.","modality":"video","input_text":null,"input_artifact_refs":[{"alt":null,"url":null,"role":null,"filename":"Airport English Conversation #english #learnenglish.publer.com.mp4"}],"stresses":["Structured speech translation accuracy","English-to-Spanish narration quality","Longer-phrase lip-sync consistency","Clear voice rendering for informational content","Export/download reliability in a simple speaking scenario"],"verdict":"failed","score":null,"score_total":null,"note":"The banana-ripeness labels stayed in English ('Unripe,' 'Ripe,' 'Overripe,' 'Rotten') instead of being localized to Spanish.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/29682d7427314802913b4fadccc386f7.mp4?v=1","role":null,"alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/9927e089ead84837aa1be3792400a94f.mp4?v=1","role":null,"alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/984b2941afe34df6b22ce7ce0a3c8d97.mp4?v=1","role":null,"alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/0fd26868a39742b6b479f04564bd0112.png?v=1","role":"context","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/e8862f74bff4424ba64eb5eaaa437761.png?v=1","role":"context","alt":null}],"run_id":"ec1dd100-6af8-4f49-8f19-b78492702b14","study_title":"Translate Videos with Voice Cloning and Lip Sync Using AI","study_kind":"generation","research_task":"86b96dfpf","tested_at":null,"completeness":"output-only","input":{"state":"not-captured","text":null,"files":[],"modality":"video","stresses":["Structured speech translation accuracy","English-to-Spanish narration quality","Longer-phrase lip-sync consistency","Clear voice rendering for informational content","Export/download reliability in a simple speaking scenario"]},"tool_page_slug":"akool","tool_url":"https://aidemos.com/tools/akool","permalink":"https://aidemos.com/evidence/5184836d-0085-424a-90b0-fa1229ea5980","api_url":"https://ai.aidemos.com/v1/observations/5184836d-0085-424a-90b0-fa1229ea5980"},"peers":[{"id":"306aed44-eee9-49aa-8551-d79216eccc42","tool":"camb-ai","tool_name":"Camb.AI","verdict":"failed","score":null,"score_total":null,"note":"On the educational banana-ripeness clip, the diagram labels stayed in English—'Unripe', 'Ripe', 'Overripe', and 'Rotten'—so graphic text was not translated into Spanish.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/afb7cecb26a949c4b305f41067fdf3ab.png?v=1","evidence_url":"https://aidemos.com/evidence/306aed44-eee9-49aa-8551-d79216eccc42"},{"id":"5b9886bf-ac83-4786-904b-3226898569df","tool":"d-id","tool_name":"D-ID","verdict":"worked","score":null,"score_total":null,"note":"It produces an accurate Spanish translation.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/5b9886bf-ac83-4786-904b-3226898569df"},{"id":"5e4686e5-ce81-4e74-82b9-a21e0b65467f","tool":"dubverse","tool_name":"Dubverse","verdict":"worked","score":null,"score_total":null,"note":"It produces highly accurate English-to-Spanish translation, preserving technical and educational content well.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/5e4686e5-ce81-4e74-82b9-a21e0b65467f"},{"id":"e3538651-7821-4212-b184-b67802cab5d5","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"The tool left the banana-ripeness labels untranslated; \"Unripe,\" \"Ripe,\" \"Overripe,\" and \"Rotten\" remained in English in the output.","artifact_count":5,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b0b7ff8a20aa4877b0d9c61ff94146e0.mp4?v=1","evidence_url":"https://aidemos.com/evidence/e3538651-7821-4212-b184-b67802cab5d5"},{"id":"b5ce2194-4698-44d9-93a8-634d5755b4b7","tool":"rask-ai","tool_name":"Rask AI","verdict":"failed","score":null,"score_total":null,"note":"The English→Spanish banana-ripeness export leaves the diagram labels in English — 'Unripe', 'Ripe', 'Overripe', and 'Rotten' — instead of translating the on-screen text.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/4606ed3f07064c06a3b82add7e30be01.mp4?v=1","evidence_url":"https://aidemos.com/evidence/b5ce2194-4698-44d9-93a8-634d5755b4b7"},{"id":"9de6d786-f08c-4fd4-9a25-301e05cd706f","tool":"sync-labs","tool_name":"Sync Labs","verdict":"worked","score":null,"score_total":null,"note":"The Spanish translation is accurate and clear, especially for structured educational speech.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/468bc86b03c74f7ebf26e56cafdd0b8f.mp4?v=1","evidence_url":"https://aidemos.com/evidence/9de6d786-f08c-4fd4-9a25-301e05cd706f"},{"id":"72dc0f6f-7ba1-49b3-bbed-d75987dd86fe","tool":"synthesia","tool_name":"Synthesia","verdict":"failed","score":null,"score_total":null,"note":"On-screen graphic translation is skipped: the banana-stage labels \"Unripe\", \"Ripe\", \"Overripe\", and \"Rotten\" stay in English throughout the Spanish output.","artifact_count":5,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/845ffbfad23742d3ace0ceb2a7c0c467.mp4?v=1","evidence_url":"https://aidemos.com/evidence/72dc0f6f-7ba1-49b3-bbed-d75987dd86fe"},{"id":"5a31aced-543f-4e45-a187-642aa7c098f4","tool":"veed","tool_name":"VEED","verdict":"worked","score":null,"score_total":null,"note":"Spoken dialogue captions translate correctly into Spanish and preserve accents, with proper accented forms visible in the output.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/e2db6468583448f28495cee5b785431e.mp4?v=1","evidence_url":"https://aidemos.com/evidence/5a31aced-543f-4e45-a187-642aa7c098f4"}],"other_criteria":[{"id":"4901b889-9bb1-4d82-9334-e83564b52a4e","criterion":"automation-level","criterion_name":"Automation Level","rank_role":"context","verdict":"mixed","score":null,"score_total":null,"note":"The output ran 7.48s versus the 9.08s source, about 18% shorter, with non-uniform compression that required content-based matching rather than timestamps.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/4901b889-9bb1-4d82-9334-e83564b52a4e"},{"id":"f87cb4ef-144c-47d0-b532-276414c110ed","criterion":"lip-sync-accuracy","criterion_name":"Lip Sync Accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"A content-matched frame comparison confirmed genuine mouth regeneration, with the output mouth shape differing from the source.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/f87cb4ef-144c-47d0-b532-276414c110ed"},{"id":"bebf098c-26fe-4e14-986e-473bc1d62486","criterion":"output-quality-export","criterion_name":"Output Quality & Export","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"The export preserved the source's 360×640 resolution and showed no corruption or color glitches.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/bebf098c-26fe-4e14-986e-473bc1d62486"}],"appears_in":[{"page_type":"ranking","slug":"video-translation-tools","title":"Best AI Tools for Video Translation with Voice Cloning and Lip Sync","url":"https://aidemos.com/best/video-translation-tools","binding":"run"},{"page_type":"ranking","slug":"ai-video-dubbing-tools","title":"Best AI Tools to Translate Videos with Voice Cloning and Lip Sync","url":"https://aidemos.com/best/ai-video-dubbing-tools","binding":"study"}],"same_scenario":[{"id":"306aed44-eee9-49aa-8551-d79216eccc42","tool":"camb-ai","tool_name":"Camb.AI","verdict":"failed","score":null,"score_total":null,"note":"On the educational banana-ripeness clip, the diagram labels stayed in English—'Unripe', 'Ripe', 'Overripe', and 'Rotten'—so graphic text was not translated into Spanish."},{"id":"5b9886bf-ac83-4786-904b-3226898569df","tool":"d-id","tool_name":"D-ID","verdict":"worked","score":null,"score_total":null,"note":"It produces an accurate Spanish translation."},{"id":"5e4686e5-ce81-4e74-82b9-a21e0b65467f","tool":"dubverse","tool_name":"Dubverse","verdict":"worked","score":null,"score_total":null,"note":"It produces highly accurate English-to-Spanish translation, preserving technical and educational content well."},{"id":"e3538651-7821-4212-b184-b67802cab5d5","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"The tool left the banana-ripeness labels untranslated; \"Unripe,\" \"Ripe,\" \"Overripe,\" and \"Rotten\" remained in English in the output."},{"id":"b5ce2194-4698-44d9-93a8-634d5755b4b7","tool":"rask-ai","tool_name":"Rask AI","verdict":"failed","score":null,"score_total":null,"note":"The English→Spanish banana-ripeness export leaves the diagram labels in English — 'Unripe', 'Ripe', 'Overripe', and 'Rotten' — instead of translating the on-screen text."},{"id":"9de6d786-f08c-4fd4-9a25-301e05cd706f","tool":"sync-labs","tool_name":"Sync Labs","verdict":"worked","score":null,"score_total":null,"note":"The Spanish translation is accurate and clear, especially for structured educational speech."},{"id":"72dc0f6f-7ba1-49b3-bbed-d75987dd86fe","tool":"synthesia","tool_name":"Synthesia","verdict":"failed","score":null,"score_total":null,"note":"On-screen graphic translation is skipped: the banana-stage labels \"Unripe\", \"Ripe\", \"Overripe\", and \"Rotten\" stay in English throughout the Spanish output."},{"id":"5a31aced-543f-4e45-a187-642aa7c098f4","tool":"veed","tool_name":"VEED","verdict":"worked","score":null,"score_total":null,"note":"Spoken dialogue captions translate correctly into Spanish and preserve accents, with proper accented forms visible in the output."}]}