{"observation":{"id":"840cd150-37f6-4b15-9fd5-6e04d13282bd","tool":"minimax","tool_name":"MiniMax","criterion":"naturalness","criterion_name":"Naturalness & Human Quality","criterion_definition":"How realistic and human-like the output sounds, including pacing, breathing, and micro-pauses.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"A voiceover tool has to sound human and listenable; unnatural pacing or robotic delivery undermines the main job. (3 of 3 judges)","scenario":"high-quality-voice-sample","scenario_name":"High-Quality Voice Sample","group_tag":"voice-cloning","scenario_description":"A clean studio-quality voice recording without background noise, used to test the best-case ceiling for voice cloning, pronunciation stability, and naturalness.","modality":"mixed","input_text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","role":"input","filename":"heygen-input-high-quality.wav"}],"stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"],"verdict":"worked","score":null,"score_total":null,"note":"The clean-input output remained human-like and good overall, though it still sounded softer than the source speaker.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-minimax-output-high-quality-64a65a87ed76.mp3","role":"output","alt":null}],"run_id":"46222c41-0046-41cc-bfaa-5f7ba6aa4933","study_title":"Clone Your Voice and Generate Voiceover from Text","study_kind":"generation","research_task":"86ba42bx1","tested_at":null,"completeness":"input-and-output","input":{"state":"text-and-files","text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","files":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-input-high-quality-884aedc4e603.wav","filename":"heygen-input-high-quality.wav","alt":"High-Quality Voice Sample","role":"input"}],"modality":"mixed","stresses":["Maximum voice-cloning accuracy","Naturalness with optimal source quality","Long-form consistency","Pronunciation stability","Voice preservation under ideal conditions"]},"tool_page_slug":"minimax-io","tool_url":"https://aidemos.com/tools/minimax-io","permalink":"https://aidemos.com/evidence/840cd150-37f6-4b15-9fd5-6e04d13282bd","api_url":"https://ai.aidemos.com/v1/observations/840cd150-37f6-4b15-9fd5-6e04d13282bd"},"peers":[{"id":"d6ee67e8-0fca-4af9-a652-d06892592855","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"worked","score":null,"score_total":null,"note":"The output sounds highly natural, with human-like delivery and speech rhythm, and the report says it is suitable for short-form content generation.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-input-high-quality-1c369166e815.wav","evidence_url":"https://aidemos.com/evidence/d6ee67e8-0fca-4af9-a652-d06892592855"},{"id":"b37ecb0b-4316-4f1c-a17f-6f589943e44a","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Sounds smoother and more human-like than the noisy-source run, though pacing inconsistencies still appear with occasional fast and slow delivery.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-elevenlabs-highquality-input-4dac94a57d04.wav","evidence_url":"https://aidemos.com/evidence/b37ecb0b-4316-4f1c-a17f-6f589943e44a"},{"id":"4257691f-67f2-4ab1-beb7-c82a2b63cab9","tool":"fish-audio","tool_name":"Fish Audio","verdict":"worked","score":null,"score_total":null,"note":"Produces natural-sounding delivery on clean input: the first high-quality output had genuinely human pitch, pauses, and overall delivery, and the second was reported as equally human-like.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-output-1-868896ae57ec.mp3","evidence_url":"https://aidemos.com/evidence/4257691f-67f2-4ab1-beb7-c82a2b63cab9"},{"id":"3e841b26-1213-464f-a700-cbcad3e2d9d4","tool":"heygen","tool_name":"Heygen","verdict":"mixed","score":null,"score_total":null,"note":"The first high-quality clone was around 80% human-like, but it still retained synthetic characteristics.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-output-high-quality-variant-1-59bbb4407317.wav","evidence_url":"https://aidemos.com/evidence/3e841b26-1213-464f-a700-cbcad3e2d9d4"},{"id":"0c7ae9e9-dc06-4aeb-af49-4664697fc567","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"The high-quality output landed at roughly 70–80% human-like and was judged to have solid naturalness overall.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-highquality-input-5a7af892998c.wav","evidence_url":"https://aidemos.com/evidence/0c7ae9e9-dc06-4aeb-af49-4664697fc567"},{"id":"431959bc-0829-4537-91cb-df92cd43a08c","tool":"speechify","tool_name":"Speechify","verdict":"mixed","score":70.0,"score_total":100.0,"note":"The clean source sounded fairly natural, but the researcher still heard noticeable robotic coloration, estimating it at about 70% natural and 30% AI-sounding.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-speechify-highquality-input-cd6fe714e081.wav","evidence_url":"https://aidemos.com/evidence/431959bc-0829-4537-91cb-df92cd43a08c"},{"id":"29181eec-a14d-4508-97c6-e0a5e0f9345c","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"struggled","score":null,"score_total":null,"note":"Gen still sounds robotic on the clean source sample, making it less convincing than HD.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-highquality-input-6c26a9323e7b.wav","evidence_url":"https://aidemos.com/evidence/29181eec-a14d-4508-97c6-e0a5e0f9345c"},{"id":"36d63d33-707c-4265-95d6-5bbea891d148","tool":"uberduck","tool_name":"Uberduck","verdict":"failed","score":null,"score_total":null,"note":"The cleaner input still produced a robotic delivery with awkward pauses breaking up the speech.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-high-quality-input-recording-f326629d7802.mp4","evidence_url":"https://aidemos.com/evidence/36d63d33-707c-4265-95d6-5bbea891d148"},{"id":"ef698e18-aed2-4143-8946-47bbd6e3ea4b","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The output sounded smooth and pleasant, with the report estimating it at about 70–80% human-like.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-output-high-quality-1583ecfff017.wav","evidence_url":"https://aidemos.com/evidence/ef698e18-aed2-4143-8946-47bbd6e3ea4b"}],"other_criteria":[{"id":"c62a8366-7e61-4481-89d2-713802e118f4","criterion":"long-form-consistency","criterion_name":"Long-Form Consistency","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The complete ~19-second output held up fine at that length, with no visible degradation reported within the generated clip.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/c62a8366-7e61-4481-89d2-713802e118f4"},{"id":"f6ef9e8a-c48a-4142-9267-dfec1a4dfc05","criterion":"pronunciation-accuracy","criterion_name":"Pronunciation Accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"No misread or garbled words were noted on the clean-input generation.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/f6ef9e8a-c48a-4142-9267-dfec1a4dfc05"},{"id":"b9f0a7be-3871-41aa-bb76-0d5c5562c30c","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Even with a clean source recording, matching accuracy still was not fully there; the report rates this run as Fair (~35–45%) and says the output leaned softer than the original voice.","artifact_count":7,"evidence_url":"https://aidemos.com/evidence/b9f0a7be-3871-41aa-bb76-0d5c5562c30c"}],"appears_in":[{"page_type":"ranking","slug":"voice-cloning-tools","title":"Best AI Tools to Clone Your Voice and Generate Voiceovers from Text","url":"https://aidemos.com/best/voice-cloning-tools","binding":"run"}],"same_scenario":[{"id":"d6ee67e8-0fca-4af9-a652-d06892592855","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"worked","score":null,"score_total":null,"note":"The output sounds highly natural, with human-like delivery and speech rhythm, and the report says it is suitable for short-form content generation."},{"id":"b37ecb0b-4316-4f1c-a17f-6f589943e44a","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"worked","score":null,"score_total":null,"note":"Sounds smoother and more human-like than the noisy-source run, though pacing inconsistencies still appear with occasional fast and slow delivery."},{"id":"4257691f-67f2-4ab1-beb7-c82a2b63cab9","tool":"fish-audio","tool_name":"Fish Audio","verdict":"worked","score":null,"score_total":null,"note":"Produces natural-sounding delivery on clean input: the first high-quality output had genuinely human pitch, pauses, and overall delivery, and the second was reported as equally human-like."},{"id":"3e841b26-1213-464f-a700-cbcad3e2d9d4","tool":"heygen","tool_name":"Heygen","verdict":"mixed","score":null,"score_total":null,"note":"The first high-quality clone was around 80% human-like, but it still retained synthetic characteristics."},{"id":"0c7ae9e9-dc06-4aeb-af49-4664697fc567","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"The high-quality output landed at roughly 70–80% human-like and was judged to have solid naturalness overall."},{"id":"431959bc-0829-4537-91cb-df92cd43a08c","tool":"speechify","tool_name":"Speechify","verdict":"mixed","score":70.0,"score_total":100.0,"note":"The clean source sounded fairly natural, but the researcher still heard noticeable robotic coloration, estimating it at about 70% natural and 30% AI-sounding."},{"id":"29181eec-a14d-4508-97c6-e0a5e0f9345c","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"struggled","score":null,"score_total":null,"note":"Gen still sounds robotic on the clean source sample, making it less convincing than HD."},{"id":"36d63d33-707c-4265-95d6-5bbea891d148","tool":"uberduck","tool_name":"Uberduck","verdict":"failed","score":null,"score_total":null,"note":"The cleaner input still produced a robotic delivery with awkward pauses breaking up the speech."},{"id":"ef698e18-aed2-4143-8946-47bbd6e3ea4b","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The output sounded smooth and pleasant, with the report estimating it at about 70–80% human-like."}]}