{"observation":{"id":"771a8879-2655-4892-bbf7-9da8f72df423","tool":"vocalai","tool_name":"VocalAI","criterion":"pronunciation-accuracy","criterion_name":"Pronunciation Accuracy","criterion_definition":"How well the tool handles names, technical terms, numbers, acronyms, and other tricky pronunciations.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If a cloned voice cannot handle names, numbers, acronyms, and technical terms correctly, it fails at producing usable voiceover. (3 of 3 judges)","scenario":"high-quality-voice-sample","scenario_name":"High-Quality Voice Sample","group_tag":"voice-cloning","scenario_description":"A clean studio-quality voice recording without background noise, used to test the best-case ceiling for voice cloning, pronunciation stability, and naturalness.","modality":"mixed","input_text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","role":"input","filename":"heygen-input-high-quality.wav"}],"stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"],"verdict":"worked","score":null,"score_total":null,"note":"The clean-sample run showed no major pronunciation errors.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-output-high-quality-1583ecfff017.wav","role":"output","alt":null}],"run_id":"46222c41-0046-41cc-bfaa-5f7ba6aa4933","study_title":"Clone Your Voice and Generate Voiceover from Text","study_kind":"generation","research_task":"86ba42bx1","tested_at":null,"completeness":"input-and-output","input":{"state":"text-and-files","text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","files":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","filename":"heygen-input-high-quality.wav","alt":"High-Quality Voice Sample","role":"input"}],"modality":"mixed","stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"]},"tool_page_slug":"vocalai","tool_url":"https://aidemos.com/tools/vocalai","permalink":"https://aidemos.com/evidence/771a8879-2655-4892-bbf7-9da8f72df423","api_url":"https://ai.aidemos.com/v1/observations/771a8879-2655-4892-bbf7-9da8f72df423"},"peers":[{"id":"a7f33961-1c6f-4dbe-b305-e2aba9be8aa1","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"mixed","score":null,"score_total":null,"note":"Pronunciation is not perfect even when identity matching is strong: the report notes minor pronunciation issues in the clean-voice output.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-input-high-quality-1c369166e815.wav","evidence_url":"https://aidemos.com/evidence/a7f33961-1c6f-4dbe-b305-e2aba9be8aa1"},{"id":"a5510a96-7de7-461e-b9d0-fb42048de7a3","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Pronounces words correctly in the long-form English output, with pronunciation reported as stable across the generated script.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-elevenlabs-highquality-input-4dac94a57d04.wav","evidence_url":"https://aidemos.com/evidence/a5510a96-7de7-461e-b9d0-fb42048de7a3"},{"id":"e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6","tool":"fish-audio","tool_name":"Fish Audio","verdict":"mixed","score":null,"score_total":null,"note":"Can still make isolated pronunciation mistakes on clean English input: one high-quality output had a single mispronounced word, about 2–3% of the generation, while the paired output had no such issue.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-output-1-868896ae57ec.mp3","evidence_url":"https://aidemos.com/evidence/e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6"},{"id":"bec90023-a4d6-4a2d-8587-0e2eb94efd8f","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted in the high-quality pass, and no dedicated pronunciation stress test was run on that scenario.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-highquality-input-5a7af892998c.wav","evidence_url":"https://aidemos.com/evidence/bec90023-a4d6-4a2d-8587-0e2eb94efd8f"},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-minimax-output-high-quality-64a65a87ed76.mp3","evidence_url":"https://aidemos.com/evidence/f6ef9e8a-c48a-4142-9267-dfec1a4dfc05"},{"id":"ceae86e2-aaab-4ec2-a167-9f3a6b449892","tool":"speechify","tool_name":"Speechify","verdict":"worked","score":null,"score_total":null,"note":"The clean-output pass also stayed pronunciation-clear, with no flagged mispronounced words.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-speechify-highquality-input-cd6fe714e081.wav","evidence_url":"https://aidemos.com/evidence/ceae86e2-aaab-4ec2-a167-9f3a6b449892"},{"id":"b62a2ccb-2b14-4585-b4de-0b510c9887c2","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"worked","score":null,"score_total":null,"note":"Gen keeps the script intelligible on the clean sample; the robotic character is a delivery issue, not misread words.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-highquality-input-6c26a9323e7b.wav","evidence_url":"https://aidemos.com/evidence/b62a2ccb-2b14-4585-b4de-0b510c9887c2"},{"id":"7d5bd84f-3369-49b9-9539-32d3849c8a66","tool":"uberduck","tool_name":"Uberduck","verdict":"worked","score":null,"score_total":null,"note":"English words remained intelligible, and the cleaner source did not change that ceiling on this run.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-recording-f326629d7802.mp4","evidence_url":"https://aidemos.com/evidence/7d5bd84f-3369-49b9-9539-32d3849c8a66"}],"other_criteria":[{"id":"2ae4e858-ea5a-4e0e-816a-197ac880c680","criterion":"long-form-consistency","criterion_name":"Long-Form Consistency","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Consistency was maintained throughout the script, though the speech still ran faster than expected.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/2ae4e858-ea5a-4e0e-816a-197ac880c680"},{"id":"ef698e18-aed2-4143-8946-47bbd6e3ea4b","criterion":"naturalness","criterion_name":"Naturalness & Human Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The output sounded smooth and pleasant, with the report estimating it at about 70–80% human-like.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/ef698e18-aed2-4143-8946-47bbd6e3ea4b"},{"id":"e71e3f67-5a4f-46d3-acea-6bac6c6ceb8f","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Even with a clean studio sample, similarity stayed at only about 10–15%, so the cleaner input produced minimal improvement in identity preservation.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/e71e3f67-5a4f-46d3-acea-6bac6c6ceb8f"}],"appears_in":[{"page_type":"ranking","slug":"voice-cloning-tools","title":"Best AI Tools to Clone Your Voice and Generate Voiceovers from Text","url":"https://aidemos.com/best/voice-cloning-tools","binding":"run"}],"same_scenario":[{"id":"a7f33961-1c6f-4dbe-b305-e2aba9be8aa1","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"mixed","score":null,"score_total":null,"note":"Pronunciation is not perfect even when identity matching is strong: the report notes minor pronunciation issues in the clean-voice output."},{"id":"a5510a96-7de7-461e-b9d0-fb42048de7a3","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Pronounces words correctly in the long-form English output, with pronunciation reported as stable across the generated script."},{"id":"e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6","tool":"fish-audio","tool_name":"Fish Audio","verdict":"mixed","score":null,"score_total":null,"note":"Can still make isolated pronunciation mistakes on clean English input: one high-quality output had a single mispronounced word, about 2–3% of the generation, while the paired output had no such issue."},{"id":"bec90023-a4d6-4a2d-8587-0e2eb94efd8f","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted in the high-quality pass, and no dedicated pronunciation stress test was run on that scenario."},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation."},{"id":"ceae86e2-aaab-4ec2-a167-9f3a6b449892","tool":"speechify","tool_name":"Speechify","verdict":"worked","score":null,"score_total":null,"note":"The clean-output pass also stayed pronunciation-clear, with no flagged mispronounced words."},{"id":"b62a2ccb-2b14-4585-b4de-0b510c9887c2","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"worked","score":null,"score_total":null,"note":"Gen keeps the script intelligible on the clean sample; the robotic character is a delivery issue, not misread words."},{"id":"7d5bd84f-3369-49b9-9539-32d3849c8a66","tool":"uberduck","tool_name":"Uberduck","verdict":"worked","score":null,"score_total":null,"note":"English words remained intelligible, and the cleaner source did not change that ceiling on this run."}]}