{"observation":{"id":"ceae86e2-aaab-4ec2-a167-9f3a6b449892","tool":"speechify","tool_name":"Speechify","criterion":"pronunciation-accuracy","criterion_name":"Pronunciation Accuracy","criterion_definition":"How well the tool handles names, technical terms, numbers, acronyms, and other tricky pronunciations.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If a cloned voice cannot handle names, numbers, acronyms, and technical terms correctly, it fails at producing usable voiceover. (3 of 3 judges)","scenario":"high-quality-voice-sample","scenario_name":"High-Quality Voice Sample","group_tag":"voice-cloning","scenario_description":"A clean studio-quality voice recording without background noise, used to test the best-case ceiling for voice cloning, pronunciation stability, and naturalness.","modality":"mixed","input_text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","role":"input","filename":"heygen-input-high-quality.wav"}],"stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"],"verdict":"worked","score":null,"score_total":null,"note":"The clean-output pass also stayed pronunciation-clear, with no flagged mispronounced words.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-speechify-highquality-input-cd6fe714e081.wav","role":"input","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-speechify-output-high-quality-d1d0bd9972e7.wav","role":"output","alt":null}],"run_id":"46222c41-0046-41cc-bfaa-5f7ba6aa4933","study_title":"Clone Your Voice and Generate Voiceover from Text","study_kind":"generation","research_task":"86ba42bx1","tested_at":null,"completeness":"input-and-output","input":{"state":"text-and-files","text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","files":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","filename":"heygen-input-high-quality.wav","alt":"High-Quality Voice Sample","role":"input"}],"modality":"mixed","stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"]},"tool_page_slug":"speechify","tool_url":"https://aidemos.com/tools/speechify","permalink":"https://aidemos.com/evidence/ceae86e2-aaab-4ec2-a167-9f3a6b449892","api_url":"https://ai.aidemos.com/v1/observations/ceae86e2-aaab-4ec2-a167-9f3a6b449892"},"peers":[{"id":"a7f33961-1c6f-4dbe-b305-e2aba9be8aa1","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"mixed","score":null,"score_total":null,"note":"Pronunciation is not perfect even when identity matching is strong: the report notes minor pronunciation issues in the clean-voice output.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-input-high-quality-1c369166e815.wav","evidence_url":"https://aidemos.com/evidence/a7f33961-1c6f-4dbe-b305-e2aba9be8aa1"},{"id":"a5510a96-7de7-461e-b9d0-fb42048de7a3","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Pronounces words correctly in the long-form English output, with pronunciation reported as stable across the generated script.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-elevenlabs-highquality-input-4dac94a57d04.wav","evidence_url":"https://aidemos.com/evidence/a5510a96-7de7-461e-b9d0-fb42048de7a3"},{"id":"e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6","tool":"fish-audio","tool_name":"Fish Audio","verdict":"mixed","score":null,"score_total":null,"note":"Can still make isolated pronunciation mistakes on clean English input: one high-quality output had a single mispronounced word, about 2–3% of the generation, while the paired output had no such issue.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-output-1-868896ae57ec.mp3","evidence_url":"https://aidemos.com/evidence/e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6"},{"id":"bec90023-a4d6-4a2d-8587-0e2eb94efd8f","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted in the high-quality pass, and no dedicated pronunciation stress test was run on that scenario.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-highquality-input-5a7af892998c.wav","evidence_url":"https://aidemos.com/evidence/bec90023-a4d6-4a2d-8587-0e2eb94efd8f"},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-minimax-output-high-quality-64a65a87ed76.mp3","evidence_url":"https://aidemos.com/evidence/f6ef9e8a-c48a-4142-9267-dfec1a4dfc05"},{"id":"b62a2ccb-2b14-4585-b4de-0b510c9887c2","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"worked","score":null,"score_total":null,"note":"Gen keeps the script intelligible on the clean sample; the robotic character is a delivery issue, not misread words.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-highquality-input-6c26a9323e7b.wav","evidence_url":"https://aidemos.com/evidence/b62a2ccb-2b14-4585-b4de-0b510c9887c2"},{"id":"7d5bd84f-3369-49b9-9539-32d3849c8a66","tool":"uberduck","tool_name":"Uberduck","verdict":"worked","score":null,"score_total":null,"note":"English words remained intelligible, and the cleaner source did not change that ceiling on this run.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-recording-f326629d7802.mp4","evidence_url":"https://aidemos.com/evidence/7d5bd84f-3369-49b9-9539-32d3849c8a66"},{"id":"771a8879-2655-4892-bbf7-9da8f72df423","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The clean-sample run showed no major pronunciation errors.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-output-high-quality-1583ecfff017.wav","evidence_url":"https://aidemos.com/evidence/771a8879-2655-4892-bbf7-9da8f72df423"}],"other_criteria":[{"id":"431959bc-0829-4537-91cb-df92cd43a08c","criterion":"naturalness","criterion_name":"Naturalness & Human Quality","rank_role":"decisive","verdict":"mixed","score":70.0,"score_total":100.0,"note":"The clean source sounded fairly natural, but the researcher still heard noticeable robotic coloration, estimating it at about 70% natural and 30% AI-sounding.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/431959bc-0829-4537-91cb-df92cd43a08c"},{"id":"a928a78c-e71f-4cc2-9000-714d3622ff79","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"struggled","score":40.0,"score_total":100.0,"note":"The clean source only matched modestly, at about 40% similarity, with roughly 60% of the output sounding noticeably different from the original.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/a928a78c-e71f-4cc2-9000-714d3622ff79"}],"appears_in":[{"page_type":"ranking","slug":"voice-cloning-tools","title":"Best AI Tools to Clone Your Voice and Generate Voiceovers from Text","url":"https://aidemos.com/best/voice-cloning-tools","binding":"run"}],"same_scenario":[{"id":"a7f33961-1c6f-4dbe-b305-e2aba9be8aa1","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"mixed","score":null,"score_total":null,"note":"Pronunciation is not perfect even when identity matching is strong: the report notes minor pronunciation issues in the clean-voice output."},{"id":"a5510a96-7de7-461e-b9d0-fb42048de7a3","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Pronounces words correctly in the long-form English output, with pronunciation reported as stable across the generated script."},{"id":"e5f193fd-54a7-4c7b-bcb4-a7615a65bfd6","tool":"fish-audio","tool_name":"Fish Audio","verdict":"mixed","score":null,"score_total":null,"note":"Can still make isolated pronunciation mistakes on clean English input: one high-quality output had a single mispronounced word, about 2–3% of the generation, while the paired output had no such issue."},{"id":"bec90023-a4d6-4a2d-8587-0e2eb94efd8f","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted in the high-quality pass, and no dedicated pronunciation stress test was run on that scenario."},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation."},{"id":"b62a2ccb-2b14-4585-b4de-0b510c9887c2","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"worked","score":null,"score_total":null,"note":"Gen keeps the script intelligible on the clean sample; the robotic character is a delivery issue, not misread words."},{"id":"7d5bd84f-3369-49b9-9539-32d3849c8a66","tool":"uberduck","tool_name":"Uberduck","verdict":"worked","score":null,"score_total":null,"note":"English words remained intelligible, and the cleaner source did not change that ceiling on this run."},{"id":"771a8879-2655-4892-bbf7-9da8f72df423","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The clean-sample run showed no major pronunciation errors."}]}