{"observation":{"id":"fed4fa9f-93c1-4534-9b93-1afcf481b19e","tool":"inworld","tool_name":"Inworld","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","criterion_definition":"Whether the generated voice actually sounds like the original speaker, including tone, pitch, rhythm, and identity.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"This ranking is fundamentally about whether the generated speech still sounds like the target speaker, so identity match is core. (3 of 3 judges)","scenario":"multilingual-voice-sample-hindi","scenario_name":"Multilingual Voice Sample (Hindi)","group_tag":"voice-cloning","scenario_description":"A Hindi-language generation prompt applied to the already-cloned voice to test cross-language speaker preservation, pronunciation accuracy, and multilingual consistency across tools.","modality":"text","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-hindi-script-input-fe71b875f774.txt","role":"input","filename":"heygen_hindi_script_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-hindi-script-input-446f5191928a.txt","role":"input","filename":"topmediai_hindi_script_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--vocalai-hindi-input-268187bdf25d.txt","role":"input","filename":"vocalai_hindi_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--aiclonevoicefree-hindi-input-43755ffcd760.txt","role":"input","filename":"aiclonevoicefree_hindi_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--elevenlabs-hindi-input-626ee5e1316f.txt","role":"input","filename":"elevenlabs_hindi_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--minimax-hindi-input-3f25c2e82e07.txt","role":"input","filename":"minimax_hindi_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--inworld-hindi-input-1d7bed5dd782.txt","role":"input","filename":"inworld_hindi_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--fishaudio-hindi-input-3c6701eea64d.txt","role":"input","filename":"fishaudio_hindi_input.txt"},{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-uberduck-hindi-input-2eac37eaf4b8.txt","role":"input","filename":"uberduck_hindi_input.txt"}],"stresses":["Multilingual voice generation","Cross-language speaker preservation","Pronunciation accuracy in Hindi","Tone, pitch, and pacing consistency across languages","Long-form multilingual reliability"],"verdict":"struggled","score":null,"score_total":null,"note":"In Hindi, speaker identity dropped noticeably and was significantly off overall versus the English reference output, so cross-language voice preservation was weak.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-output-low-quality-7802dbac0648.mp3","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-output-multilingual-fc9ec68a818b.mp3","role":"output","alt":null}],"run_id":"46222c41-0046-41cc-bfaa-5f7ba6aa4933","study_title":"Clone Your Voice and Generate Voiceover from Text","study_kind":"generation","research_task":"86ba42bx1","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-hindi-script-input-fe71b875f774.txt","filename":"heygen_hindi_script_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-hindi-script-input-446f5191928a.txt","filename":"topmediai_hindi_script_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--vocalai-hindi-input-268187bdf25d.txt","filename":"vocalai_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--aiclonevoicefree-hindi-input-43755ffcd760.txt","filename":"aiclonevoicefree_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--elevenlabs-hindi-input-626ee5e1316f.txt","filename":"elevenlabs_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--minimax-hindi-input-3f25c2e82e07.txt","filename":"minimax_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--inworld-hindi-input-1d7bed5dd782.txt","filename":"inworld_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/clone-your-voice-and-generate-voiceover--fishaudio-hindi-input-3c6701eea64d.txt","filename":"fishaudio_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-uberduck-hindi-input-2eac37eaf4b8.txt","filename":"uberduck_hindi_input.txt","alt":"Multilingual Voice Sample (Hindi)","role":"input"}],"modality":"text","stresses":["Multilingual voice generation","Cross-language speaker preservation","Pronunciation accuracy in Hindi","Tone, pitch, and pacing consistency across languages","Long-form multilingual reliability"]},"tool_page_slug":null,"tool_url":null,"permalink":"https://aidemos.com/evidence/fed4fa9f-93c1-4534-9b93-1afcf481b19e","api_url":"https://ai.aidemos.com/v1/observations/fed4fa9f-93c1-4534-9b93-1afcf481b19e"},"peers":[{"id":"ac816a21-f897-41c6-b701-19f0d23a954a","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"struggled","score":null,"score_total":null,"note":"Cross-language speaker identity preservation drops sharply in Hindi: the generated voice sounds noticeably different from the English reference output rather than retaining the same speaker identity well.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-aiclonevoicefree-output-multilingual-445effae1957.mp3","evidence_url":"https://aidemos.com/evidence/ac816a21-f897-41c6-b701-19f0d23a954a"},{"id":"1475dcbd-e977-4b03-b3b7-cf55f5f094dc","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"failed","score":null,"score_total":null,"note":"Speaker identity retention drops sharply in Hindi: the report says the clone is poor in Hindi and does not closely resemble the original speaker when compared against the English reference outputs.","artifact_count":5,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-elevenlabs-hindi-script-input-8cffd5de94b9.txt","evidence_url":"https://aidemos.com/evidence/1475dcbd-e977-4b03-b3b7-cf55f5f094dc"},{"id":"8b01f9f6-a772-4438-98ee-e0b04a0d1a80","tool":"fish-audio","tool_name":"Fish Audio","verdict":"worked","score":null,"score_total":null,"note":"Retains speaker identity across English-to-Hindi cloning: the Hindi output was judged a strong, consistent match to the tool's own English reference output, and the second Hindi render matched the first.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-output-1-868896ae57ec.mp3","evidence_url":"https://aidemos.com/evidence/8b01f9f6-a772-4438-98ee-e0b04a0d1a80"},{"id":"17a1e524-2563-42f3-9019-bfa76234548d","tool":"heygen","tool_name":"Heygen","verdict":"mixed","score":null,"score_total":null,"note":"The Hindi clone preserved some of the original speaker's vocal characteristics, but it was not a close match overall when compared against the English best-variant reference output.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-output-multilingual-9b4cbddb338d.wav","evidence_url":"https://aidemos.com/evidence/17a1e524-2563-42f3-9019-bfa76234548d"},{"id":"a5504bab-bddd-476a-a3c2-d112f4c5e28a","tool":"minimax","tool_name":"MiniMax","verdict":"struggled","score":null,"score_total":null,"note":"Speaker identity preservation dropped to about 20–30% in Hindi, down from roughly 35–45% in English, so the cloned voice largely lost its original character in cross-language generation.","artifact_count":4,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-minimax-output-high-quality-64a65a87ed76.mp3","evidence_url":"https://aidemos.com/evidence/a5504bab-bddd-476a-a3c2-d112f4c5e28a"},{"id":"e5d749b1-909d-4e87-a6b4-da6bd464217d","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"mixed","score":null,"score_total":null,"note":"In Hindi, HD preserves speaker identity inconsistently: some sections stay close to the original voice while others sound noticeably different.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-hindi-script-input-446f5191928a.txt","evidence_url":"https://aidemos.com/evidence/e5d749b1-909d-4e87-a6b4-da6bd464217d"},{"id":"ea2de3c1-818f-4388-b3fc-3d73c1a5873f","tool":"uberduck","tool_name":"Uberduck","verdict":"failed","score":null,"score_total":null,"note":"The Hindi output bore no real resemblance to the source speaker and was judged the weakest identity-preservation result in the set.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-uberduck-multilingual-output-4d84e3518dae.wav","evidence_url":"https://aidemos.com/evidence/ea2de3c1-818f-4388-b3fc-3d73c1a5873f"},{"id":"7359f584-07e9-4a62-9a73-3bf6abb9f6c8","tool":"vocalai","tool_name":"VocalAI","verdict":"struggled","score":null,"score_total":null,"note":"In Hindi, the cloned voice preserved only about 15–20% of the original speaker's identity, with most of the output sounding significantly different from the source voice.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-hindi-script-input-45f553f978ac.txt","evidence_url":"https://aidemos.com/evidence/7359f584-07e9-4a62-9a73-3bf6abb9f6c8"}],"other_criteria":[{"id":"14d0420b-6b5f-416d-830b-6162388f08c3","criterion":"long-form-consistency","criterion_name":"Long-Form Consistency","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Over the longer Hindi passage, the output stayed reasonably usable, but the report still frames it as mainly suitable for general voice generation rather than exact identity preservation.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/14d0420b-6b5f-416d-830b-6162388f08c3"},{"id":"66ad9d87-caf1-443c-83d2-9cc73308c803","criterion":"multilingual-output-quality","criterion_name":"Multilingual Output Quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The tool can generate cloned speech from a pasted Hindi script, but the overall cross-language result was only middling because the sample was not fully satisfying even though the language remained intelligible.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/66ad9d87-caf1-443c-83d2-9cc73308c803"},{"id":"572fda50-1c84-4b1d-bd17-6af1d72557ed","criterion":"naturalness","criterion_name":"Naturalness & Human Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The Hindi output still sounded human, with natural pauses and phrasing and no robotic quality.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/572fda50-1c84-4b1d-bd17-6af1d72557ed"},{"id":"e85b529d-28a8-42ea-899b-aa131671a8b5","criterion":"pronunciation-accuracy","criterion_name":"Pronunciation Accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Hindi pronunciation was a genuine strength: words came through clearly and naturally in the full non-English script.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/e85b529d-28a8-42ea-899b-aa131671a8b5"}],"appears_in":[{"page_type":"ranking","slug":"voice-cloning-tools","title":"Best AI Tools to Clone Your Voice and Generate Voiceovers from Text","url":"https://aidemos.com/best/voice-cloning-tools","binding":"run"}],"same_scenario":[{"id":"ac816a21-f897-41c6-b701-19f0d23a954a","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"struggled","score":null,"score_total":null,"note":"Cross-language speaker identity preservation drops sharply in Hindi: the generated voice sounds noticeably different from the English reference output rather than retaining the same speaker identity well."},{"id":"1475dcbd-e977-4b03-b3b7-cf55f5f094dc","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"failed","score":null,"score_total":null,"note":"Speaker identity retention drops sharply in Hindi: the report says the clone is poor in Hindi and does not closely resemble the original speaker when compared against the English reference outputs."},{"id":"8b01f9f6-a772-4438-98ee-e0b04a0d1a80","tool":"fish-audio","tool_name":"Fish Audio","verdict":"worked","score":null,"score_total":null,"note":"Retains speaker identity across English-to-Hindi cloning: the Hindi output was judged a strong, consistent match to the tool's own English reference output, and the second Hindi render matched the first."},{"id":"17a1e524-2563-42f3-9019-bfa76234548d","tool":"heygen","tool_name":"Heygen","verdict":"mixed","score":null,"score_total":null,"note":"The Hindi clone preserved some of the original speaker's vocal characteristics, but it was not a close match overall when compared against the English best-variant reference output."},{"id":"a5504bab-bddd-476a-a3c2-d112f4c5e28a","tool":"minimax","tool_name":"MiniMax","verdict":"struggled","score":null,"score_total":null,"note":"Speaker identity preservation dropped to about 20–30% in Hindi, down from roughly 35–45% in English, so the cloned voice largely lost its original character in cross-language generation."},{"id":"e5d749b1-909d-4e87-a6b4-da6bd464217d","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"mixed","score":null,"score_total":null,"note":"In Hindi, HD preserves speaker identity inconsistently: some sections stay close to the original voice while others sound noticeably different."},{"id":"ea2de3c1-818f-4388-b3fc-3d73c1a5873f","tool":"uberduck","tool_name":"Uberduck","verdict":"failed","score":null,"score_total":null,"note":"The Hindi output bore no real resemblance to the source speaker and was judged the weakest identity-preservation result in the set."},{"id":"7359f584-07e9-4a62-9a73-3bf6abb9f6c8","tool":"vocalai","tool_name":"VocalAI","verdict":"struggled","score":null,"score_total":null,"note":"In Hindi, the cloned voice preserved only about 15–20% of the original speaker's identity, with most of the output sounding significantly different from the source voice."}]}