{"observation":{"id":"bec90023-a4d6-4a2d-8587-0e2eb94efd8f","tool":"inworld","tool_name":"Inworld","criterion":"pronunciation-accuracy","criterion_name":"Pronunciation Accuracy","criterion_definition":"How well the tool handles names, technical terms, numbers, acronyms, and other tricky pronunciations.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If a cloned voice cannot handle names, numbers, acronyms, and technical terms correctly, it fails at producing usable voiceover. (3 of 3 judges)","scenario":"high-quality-voice-sample","scenario_name":"High-Quality Voice Sample","group_tag":"voice-cloning","scenario_description":"A clean studio-quality voice recording without background noise, used to test the best-case ceiling for voice cloning, pronunciation stability, and naturalness.","modality":"mixed","input_text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","role":"input","filename":"heygen-input-high-quality.wav"}],"stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"],"verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted in the high-quality pass, and no dedicated pronunciation stress test was run on that scenario.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-highquality-input-5a7af892998c.wav","role":"input","alt":"Research media inworld highquality input.wav"},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-output-high-quality-761809983406.mp3","role":"output","alt":null}],"run_id":"46222c41-0046-41cc-bfaa-5f7ba6aa4933","study_title":"Clone Your Voice and Generate Voiceover from Text","study_kind":"generation","research_task":"86ba42bx1","tested_at":null,"completeness":"input-and-output","input":{"state":"text-and-files","text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","files":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","filename":"heygen-input-high-quality.wav","alt":"High-Quality Voice Sample","role":"input"}],"modality":"mixed","stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"]},"tool_page_slug":null,"tool_url":null,"permalink":"https://aidemos.com/evidence/bec90023-a4d6-4a2d-8587-0e2eb94efd8f","api_url":"https://ai.aidemos.com/v1/observations/bec90023-a4d6-4a2d-8587-0e2eb94efd8f"},"peers":[{"id":"a7f33961-1c6f-4dbe-b305-e2aba9be8aa1","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"mixed","score":null,"score_total":null,"note":"Pronunciation is not perfect even when identity matching is strong: the report notes minor pronunciation issues in the clean-voice output.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-input-high-quality-1c369166e815.wav","evidence_url":"https://aidemos.com/evidence/a7f33961-1c6f-4dbe-b305-e2aba9be8aa1"},{"id":"a5510a96-7de7-461e-b9d0-fb42048de7a3","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Pronounces words correctly in the long-form English output, with pronunciation reported as stable across the generated script.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-elevenlabs-highquality-input-4dac94a57d04.wav","evidence_url":"https://aidemos.com/evidence/a5510a96-7de7-461e-b9d0-fb42048de7a3"},{"id":"e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6","tool":"fish-audio","tool_name":"Fish Audio","verdict":"mixed","score":null,"score_total":null,"note":"Can still make isolated pronunciation mistakes on clean English input: one high-quality output had a single mispronounced word, about 2–3% of the generation, while the paired output had no such issue.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-output-1-868896ae57ec.mp3","evidence_url":"https://aidemos.com/evidence/e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6"},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-minimax-output-high-quality-64a65a87ed76.mp3","evidence_url":"https://aidemos.com/evidence/f6ef9e8a-c48a-4142-9267-dfec1a4dfc05"},{"id":"ceae86e2-aaab-4ec2-a167-9f3a6b449892","tool":"speechify","tool_name":"Speechify","verdict":"worked","score":null,"score_total":null,"note":"The clean-output pass also stayed pronunciation-clear, with no flagged mispronounced words.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-speechify-highquality-input-cd6fe714e081.wav","evidence_url":"https://aidemos.com/evidence/ceae86e2-aaab-4ec2-a167-9f3a6b449892"},{"id":"b62a2ccb-2b14-4585-b4de-0b510c9887c2","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"worked","score":null,"score_total":null,"note":"Gen keeps the script intelligible on the clean sample; the robotic character is a delivery issue, not misread words.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-highquality-input-6c26a9323e7b.wav","evidence_url":"https://aidemos.com/evidence/b62a2ccb-2b14-4585-b4de-0b510c9887c2"},{"id":"7d5bd84f-3369-49b9-9539-32d3849c8a66","tool":"uberduck","tool_name":"Uberduck","verdict":"worked","score":null,"score_total":null,"note":"English words remained intelligible, and the cleaner source did not change that ceiling on this run.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-recording-f326629d7802.mp4","evidence_url":"https://aidemos.com/evidence/7d5bd84f-3369-49b9-9539-32d3849c8a66"},{"id":"771a8879-2655-4892-bbf7-9da8f72df423","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The clean-sample run showed no major pronunciation errors.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-output-high-quality-1583ecfff017.wav","evidence_url":"https://aidemos.com/evidence/771a8879-2655-4892-bbf7-9da8f72df423"}],"other_criteria":[{"id":"ff632063-0449-48b6-b605-f9c7176feabe","criterion":"long-form-consistency","criterion_name":"Long-Form Consistency","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"In the ~1:04 high-quality output, matching accuracy degraded further as the clip progressed, so consistency weakened over the longer passage.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/ff632063-0449-48b6-b605-f9c7176feabe"},{"id":"0c7ae9e9-dc06-4aeb-af49-4664697fc567","criterion":"naturalness","criterion_name":"Naturalness & Human Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The high-quality output landed at roughly 70–80% human-like and was judged to have solid naturalness overall.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/0c7ae9e9-dc06-4aeb-af49-4664697fc567"},{"id":"14343c6c-c79f-4fc3-9d1e-fc972c929209","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"On the clean studio sample, the clone did not match the source precisely and sounded more polished and balanced, suggesting the model optimized for pleasant delivery over exact identity.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/14343c6c-c79f-4fc3-9d1e-fc972c929209"}],"appears_in":[{"page_type":"ranking","slug":"voice-cloning-tools","title":"Best AI Tools to Clone Your Voice and Generate Voiceovers from Text","url":"https://aidemos.com/best/voice-cloning-tools","binding":"run"}],"same_scenario":[{"id":"a7f33961-1c6f-4dbe-b305-e2aba9be8aa1","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"mixed","score":null,"score_total":null,"note":"Pronunciation is not perfect even when identity matching is strong: the report notes minor pronunciation issues in the clean-voice output."},{"id":"a5510a96-7de7-461e-b9d0-fb42048de7a3","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Pronounces words correctly in the long-form English output, with pronunciation reported as stable across the generated script."},{"id":"e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6","tool":"fish-audio","tool_name":"Fish Audio","verdict":"mixed","score":null,"score_total":null,"note":"Can still make isolated pronunciation mistakes on clean English input: one high-quality output had a single mispronounced word, about 2–3% of the generation, while the paired output had no such issue."},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation."},{"id":"ceae86e2-aaab-4ec2-a167-9f3a6b449892","tool":"speechify","tool_name":"Speechify","verdict":"worked","score":null,"score_total":null,"note":"The clean-output pass also stayed pronunciation-clear, with no flagged mispronounced words."},{"id":"b62a2ccb-2b14-4585-b4de-0b510c9887c2","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"worked","score":null,"score_total":null,"note":"Gen keeps the script intelligible on the clean sample; the robotic character is a delivery issue, not misread words."},{"id":"7d5bd84f-3369-49b9-9539-32d3849c8a66","tool":"uberduck","tool_name":"Uberduck","verdict":"worked","score":null,"score_total":null,"note":"English words remained intelligible, and the cleaner source did not change that ceiling on this run."},{"id":"771a8879-2655-4892-bbf7-9da8f72df423","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The clean-sample run showed no major pronunciation errors."}]}