{"observation":{"id":"287cebc8-e1c6-43f1-9b91-082aa994d864","tool":"camb-ai","tool_name":"Camb AI","criterion":"translation-accuracy","criterion_name":"Translation Accuracy","criterion_definition":"Is the translated output semantically correct, and does it preserve technical terms, tone, and meaning?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If the translation changes meaning, tone, or technical terms, the tool fails the core job of translating the video. (3 of 3 judges)","scenario":"hindi-vlog-style-talking-head-hindi-english","scenario_name":"Hindi vlog-style talking head (Hindi → English)","group_tag":"video-translation-voice-clone-lip-sync","scenario_description":"A casual Hindi talking-head/vlog-style video used to test English dubbing on informal speech, Hinglish-like phrasing, speaker personality preservation, and lip sync under natural creator-style delivery.","modality":"video","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/c414bbbfcd2a49faa9b162d10cd64c2f.mp4?v=1","role":"input","filename":"Free Copyright Stock Videos Images And Music.publer.com (online-video-cutter.com).mp4"}],"stresses":["Informal Hindi speech transcription","Hindi-to-English translation of casual phrasing","Voice cloning for conversational creator tone","Handling of slang/Hinglish-style content","Lip-sync stability during expressive speech"],"verdict":"failed","score":null,"score_total":null,"note":"On the Hindi vlog clip, a full Hindi sentence ('JARURAT PADTI HAI') and another word ('AAP') remained untranslated, showing the tool can leave source-language on-screen text unchanged in the English output.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/43a96ac7205e4671b3c515c35f205a99.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/98edb2a4d5c549bba592c98810289f07.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/25084428e6194c758bf3284d1d28dadc.mp4?v=1","role":"output","alt":null}],"run_id":"ec1dd100-6af8-4f49-8f19-b78492702b14","study_title":"Translate Videos with Voice Cloning and Lip Sync Using AI","study_kind":"generation","research_task":"86b96dfpf","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/c414bbbfcd2a49faa9b162d10cd64c2f.mp4?v=1","filename":"Free Copyright Stock Videos Images And Music.publer.com (online-video-cutter.com).mp4","alt":"Hindi vlog-style talking head (Hindi → English)","role":"input"}],"modality":"video","stresses":["Informal Hindi speech transcription","Hindi-to-English translation of casual phrasing","Voice cloning for conversational creator tone","Handling of slang/Hinglish-style content","Lip-sync stability during expressive speech"]},"tool_page_slug":"camb-ai","tool_url":"https://aidemos.com/tools/camb-ai","permalink":"https://aidemos.com/evidence/287cebc8-e1c6-43f1-9b91-082aa994d864","api_url":"https://ai.aidemos.com/v1/observations/287cebc8-e1c6-43f1-9b91-082aa994d864"},"peers":[{"id":"f7880fff-f9aa-439e-8058-76110e89a8e0","tool":"akool","tool_name":"Akool","verdict":"failed","score":null,"score_total":null,"note":"\"JARURAT PADTI HAI\" and the later word \"BATAANE\" remained untranslated in the English dub.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/211f00ca9ecd40e2a76e2b44dbdfd903.mp4?v=1","evidence_url":"https://aidemos.com/evidence/f7880fff-f9aa-439e-8058-76110e89a8e0"},{"id":"599ea229-4a8b-4f6f-ab37-3199f54a727d","tool":"d-id","tool_name":"D-ID","verdict":"mixed","score":null,"score_total":null,"note":"The English translation is understandable, but it sounds slightly formal and less natural for casual vlog speech.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/930df2e51bdc46b7a79008de00b2b88b.mp4?v=1","evidence_url":"https://aidemos.com/evidence/599ea229-4a8b-4f6f-ab37-3199f54a727d"},{"id":"c48fd8bf-21a8-476d-a0f5-592e54989680","tool":"dubverse","tool_name":"Dubverse","verdict":"mixed","score":null,"score_total":null,"note":"The Hindi-to-English translation remains understandable and retains the overall meaning, but it degrades on slang, informal tone, and mixed-language phrasing.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/c48fd8bf-21a8-476d-a0f5-592e54989680"},{"id":"316be348-d523-4cf5-9045-a8d98c8e7660","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"The tool failed to translate the word-emphasis captions in the vlog clip; \"AAP\" and \"MAIN\" stayed untranslated in the output.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/51014ac6fa024de384455a5e38c9d103.png?v=1","evidence_url":"https://aidemos.com/evidence/316be348-d523-4cf5-9045-a8d98c8e7660"},{"id":"b049bee7-5bdb-44b1-a78f-4ec72d20082b","tool":"rask-ai","tool_name":"Rask AI","verdict":"failed","score":null,"score_total":null,"note":"The Hindi→English talking-head export renders the word-emphasis captions as Roman-script Hindi ('JARURAT PADTI HAI', 'HAR', 'BHII') instead of English, while pre-existing English branding is left untouched.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/36abe2a48a854952a3590e0ecdc03314.mp4?v=1","evidence_url":"https://aidemos.com/evidence/b049bee7-5bdb-44b1-a78f-4ec72d20082b"},{"id":"3dc48ab7-0445-4cbf-9b7f-c28f4dde7d6f","tool":"sync-labs","tool_name":"Sync Labs","verdict":"mixed","score":null,"score_total":null,"note":"The English translation is mostly correct, but it does not preserve the casual vlog tone.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/9b57806893d04376a6474d69b70c6276.mp4?v=1","evidence_url":"https://aidemos.com/evidence/3dc48ab7-0445-4cbf-9b7f-c28f4dde7d6f"},{"id":"d779c277-1fe2-4421-a1f0-528c7920c9d3","tool":"synthesia","tool_name":"Synthesia","verdict":"mixed","score":null,"score_total":null,"note":"Translation is partial in the vlog run: pre-existing English branding text is preserved correctly, but word-emphasis captions like \"HAK\" and \"MAIN\" remain untranslated in Roman script.","artifact_count":5,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/9528bcf2ff3a45c597b84d595e896206.mp4?v=1","evidence_url":"https://aidemos.com/evidence/d779c277-1fe2-4421-a1f0-528c7920c9d3"},{"id":"1e1f8faf-3b07-4aa3-ab63-88da22e098c5","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"The English dub is polluted by untranslated Romanized-Hindi caption text; 'KAR RAHE HAIN' and 'MAIN' appear in the output, and 'MAIN' is described as a fabricated caption that was not present in the source frame.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/330f9a7be00845109be703bedbb9595c.mp4?v=1","evidence_url":"https://aidemos.com/evidence/1e1f8faf-3b07-4aa3-ab63-88da22e098c5"}],"other_criteria":[{"id":"6b7e4114-5ac3-4fdf-8efa-b18734408788","criterion":"lip-sync-accuracy","criterion_name":"Lip Sync Accuracy","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"On the Hindi→English vlog clip, the output again left mouths unchanged, with only ~1.7-2.7/255 pixel difference across the 10-second clip and frame-identical mouths at t=0.0s.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/6b7e4114-5ac3-4fdf-8efa-b18734408788"}],"appears_in":[{"page_type":"ranking","slug":"video-translation-tools","title":"Best AI Tools for Video Translation with Voice Cloning and Lip Sync","url":"https://aidemos.com/best/video-translation-tools","binding":"run"},{"page_type":"ranking","slug":"ai-video-dubbing-tools","title":"Best AI Tools to Translate Videos with Voice Cloning and Lip Sync","url":"https://aidemos.com/best/ai-video-dubbing-tools","binding":"study"}],"same_scenario":[{"id":"f7880fff-f9aa-439e-8058-76110e89a8e0","tool":"akool","tool_name":"Akool","verdict":"failed","score":null,"score_total":null,"note":"\"JARURAT PADTI HAI\" and the later word \"BATAANE\" remained untranslated in the English dub."},{"id":"599ea229-4a8b-4f6f-ab37-3199f54a727d","tool":"d-id","tool_name":"D-ID","verdict":"mixed","score":null,"score_total":null,"note":"The English translation is understandable, but it sounds slightly formal and less natural for casual vlog speech."},{"id":"c48fd8bf-21a8-476d-a0f5-592e54989680","tool":"dubverse","tool_name":"Dubverse","verdict":"mixed","score":null,"score_total":null,"note":"The Hindi-to-English translation remains understandable and retains the overall meaning, but it degrades on slang, informal tone, and mixed-language phrasing."},{"id":"316be348-d523-4cf5-9045-a8d98c8e7660","tool":"heygen","tool_name":"HeyGen","verdict":"failed","score":null,"score_total":null,"note":"The tool failed to translate the word-emphasis captions in the vlog clip; \"AAP\" and \"MAIN\" stayed untranslated in the output."},{"id":"b049bee7-5bdb-44b1-a78f-4ec72d20082b","tool":"rask-ai","tool_name":"Rask AI","verdict":"failed","score":null,"score_total":null,"note":"The Hindi→English talking-head export renders the word-emphasis captions as Roman-script Hindi ('JARURAT PADTI HAI', 'HAR', 'BHII') instead of English, while pre-existing English branding is left untouched."},{"id":"3dc48ab7-0445-4cbf-9b7f-c28f4dde7d6f","tool":"sync-labs","tool_name":"Sync Labs","verdict":"mixed","score":null,"score_total":null,"note":"The English translation is mostly correct, but it does not preserve the casual vlog tone."},{"id":"d779c277-1fe2-4421-a1f0-528c7920c9d3","tool":"synthesia","tool_name":"Synthesia","verdict":"mixed","score":null,"score_total":null,"note":"Translation is partial in the vlog run: pre-existing English branding text is preserved correctly, but word-emphasis captions like \"HAK\" and \"MAIN\" remain untranslated in Roman script."},{"id":"1e1f8faf-3b07-4aa3-ab63-88da22e098c5","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"The English dub is polluted by untranslated Romanized-Hindi caption text; 'KAR RAHE HAIN' and 'MAIN' appear in the output, and 'MAIN' is described as a fabricated caption that was not present in the source frame."}]}