{"observation":{"id":"c4ea4485-6f15-493f-acb4-a438d175a88d","tool":"heygen","tool_name":"Heygen","criterion":"naturalness","criterion_name":"Naturalness & Human Quality","criterion_definition":"How realistic and human-like the output sounds, including pacing, breathing, and micro-pauses.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"A voiceover tool has to sound human and listenable; unnatural pacing or robotic delivery undermines the main job. (3 of 3 judges)","scenario":"low-quality-voice-sample","scenario_name":"Low-Quality Voice Sample","group_tag":"voice-cloning","scenario_description":"A noisy voice recording with background noise, room ambience, and minor disturbances, used to test whether voice-cloning tools can preserve speaker identity when the source audio is imperfect.","modality":"mixed","input_text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/22549a3c02994d8b9fe38fff9bfda6a0.wav?v=1","role":"input","filename":"speechify-input-low-quality.wav"}],"stresses":["Cloning accuracy from degraded audio","Noise and ambience robustness","Speaker identity preservation under poor recording conditions","Distinguishing enhancement from true cloning"],"verdict":"mixed","score":null,"score_total":null,"note":"A mid-tier low-quality clone improved rhythm and speech delivery and sounded more human-like than Output 1, but it still was not fully natural.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-output-low-quality-variant-2-90acc9fed5f4.wav","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-output-low-quality-variant-1-61517135cbaf.wav","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-heygen-output-low-quality-variant-3-best-5e23070dc089.wav","role":"output","alt":null}],"run_id":"46222c41-0046-41cc-bfaa-5f7ba6aa4933","study_title":"Clone Your Voice and Generate Voiceover from Text","study_kind":"generation","research_task":"86ba42bx1","tested_at":null,"completeness":"input-and-output","input":{"state":"text-and-files","text":"Removing objects from videos used to take hours of manual editing. Now AI tools claim to do it in minutes. So we tested five AI video object removers to find the most reliable one. We used the same three inputs across all the tools for a fair comparison. ABC Labs showed unstable tracking and heavy distortion. Media.io offered fast processing but unusable outputs. PhotoRoom mostly relied on blur masking instead of real reconstruction. Runway delivered the cleanest removals with the most stable tracking and realistic scene reconstruction. Here's exactly how we tested it.","files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/22549a3c02994d8b9fe38fff9bfda6a0.wav?v=1","filename":"speechify-input-low-quality.wav","alt":"Low-Quality Voice Sample","role":"input"}],"modality":"mixed","stresses":["Cloning accuracy from degraded audio","Noise and ambience robustness","Speaker identity preservation under poor recording conditions","Distinguishing enhancement from true cloning"]},"tool_page_slug":"heygen","tool_url":"https://aidemos.com/tools/heygen","permalink":"https://aidemos.com/evidence/c4ea4485-6f15-493f-acb4-a438d175a88d","api_url":"https://ai.aidemos.com/v1/observations/c4ea4485-6f15-493f-acb4-a438d175a88d"},"peers":[{"id":"ce882b79-c57e-4a61-b168-a1304cb6a990","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"worked","score":null,"score_total":null,"note":"The generated speech sounds natural and human-like, with smooth flow, pleasant pacing, and no major robotic artifacts noticed in the preview.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-input-low-quality-d1a2d94e8e38.wav","evidence_url":"https://aidemos.com/evidence/ce882b79-c57e-4a61-b168-a1304cb6a990"},{"id":"d43f3053-c54e-42c7-8c9d-b35187ad8316","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"mixed","score":null,"score_total":null,"note":"Produces generally good speech, but pacing swings between noticeably too fast and noticeably too slow, making the delivery feel less natural and slightly artificial.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-elevenlabs-lowquality-input-8230726a9b39.wav","evidence_url":"https://aidemos.com/evidence/d43f3053-c54e-42c7-8c9d-b35187ad8316"},{"id":"59d70211-e355-4a44-873a-a98b19034185","tool":"fish-audio","tool_name":"Fish Audio","verdict":"worked","score":null,"score_total":null,"note":"Keeps noisy-source speech sounding human-like rather than robotic: both low-quality outputs were reported as non-AI-sounding and close to the input voice's character.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-low-quality-input-output-1-93e0a51fba7b.mp3","evidence_url":"https://aidemos.com/evidence/59d70211-e355-4a44-873a-a98b19034185"},{"id":"2faea031-eb67-4f6c-b7c8-7258d9b53c0f","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"The low-quality output still sounded human rather than robotic, coming across as a genuine speaker instead of a synthetic one.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-inworld-lowquality-input-437133b0167f.wav","evidence_url":"https://aidemos.com/evidence/2faea031-eb67-4f6c-b7c8-7258d9b53c0f"},{"id":"a8bdcc87-abfa-4cdb-9967-3dc55de7afb1","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"The low-quality run still sounded human rather than robotic or AI-generated, despite the accuracy gap.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-minimax-output-low-quality-27c7c65786a5.mp3","evidence_url":"https://aidemos.com/evidence/a8bdcc87-abfa-4cdb-9967-3dc55de7afb1"},{"id":"df45fb93-e306-4fbe-a469-741589f4fd2b","tool":"speechify","tool_name":"Speechify","verdict":"worked","score":null,"score_total":null,"note":"The noisy source still yielded a natural-sounding voice in isolation.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-speechify-lowquality-input-86c01eae771e.wav","evidence_url":"https://aidemos.com/evidence/df45fb93-e306-4fbe-a469-741589f4fd2b"},{"id":"b14dd1ff-8fa6-4073-bf38-0250dbcc735e","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"struggled","score":null,"score_total":null,"note":"Gen sounds noticeably robotic and lacks emotional depth and natural speech rhythm on the noisy sample.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-topmediai-lowquality-input-5c3da58b8b17.wav","evidence_url":"https://aidemos.com/evidence/b14dd1ff-8fa6-4073-bf38-0250dbcc735e"},{"id":"5959899b-bf1b-4519-b6c4-33074f3d30c1","tool":"uberduck","tool_name":"Uberduck","verdict":"failed","score":null,"score_total":null,"note":"The output sounded heavily robotic, with frequent unnatural pauses that made it immediately identifiable as AI-generated.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-uberduck-output-low-quality-a89e3da7ab64.wav","evidence_url":"https://aidemos.com/evidence/5959899b-bf1b-4519-b6c4-33074f3d30c1"},{"id":"51acec8e-320d-4368-8430-ac7dd23cae86","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The generated speech sounded natural and human-like, with clean, easy-to-listen-to audio quality despite the weak voice match.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-vocalai-output-low-quality-89f3e7da2000.wav","evidence_url":"https://aidemos.com/evidence/51acec8e-320d-4368-8430-ac7dd23cae86"}],"other_criteria":[{"id":"ac775bf1-ecc4-4d54-a9ed-623341ccd3fe","criterion":"long-form-consistency","criterion_name":"Long-Form Consistency","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"In the longer-script generation, the voice stayed human-like but broke conversational flow, mispronounced certain words, and became inconsistent across longer passages.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/ac775bf1-ecc4-4d54-a9ed-623341ccd3fe"},{"id":"6dbaad2b-b45e-4ca8-a742-63cac1596a62","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The weakest low-quality clone was only about 20% similar to the source voice and showed a significant deviation in tone and vocal characteristics.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/6dbaad2b-b45e-4ca8-a742-63cac1596a62"},{"id":"5c83e9e6-5abd-49fb-b1bf-94d0d6b128d0","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"A mid-tier low-quality clone reached roughly 70–80% similarity to the original voice, making it acceptable for short-form use but still not fully faithful.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/5c83e9e6-5abd-49fb-b1bf-94d0d6b128d0"},{"id":"5f56a175-1dc1-405b-bb24-ba0c2dae580b","criterion":"voice-match-accuracy","criterion_name":"Voice Match Accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The best low-quality clone reached approximately 95–99% similarity to the original voice and was described as the closest to the original speaker.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/5f56a175-1dc1-405b-bb24-ba0c2dae580b"}],"appears_in":[{"page_type":"ranking","slug":"voice-cloning-tools","title":"Best AI Tools to Clone Your Voice and Generate Voiceovers from Text","url":"https://aidemos.com/best/voice-cloning-tools","binding":"run"}],"same_scenario":[{"id":"ce882b79-c57e-4a61-b168-a1304cb6a990","tool":"aiclonevoicefree-com","tool_name":"AICloneVoiceFree.com","verdict":"worked","score":null,"score_total":null,"note":"The generated speech sounds natural and human-like, with smooth flow, pleasant pacing, and no major robotic artifacts noticed in the preview."},{"id":"d43f3053-c54e-42c7-8c9d-b35187ad8316","tool":"elevenlabs","tool_name":"ElevenLabs","verdict":"mixed","score":null,"score_total":null,"note":"Produces generally good speech, but pacing swings between noticeably too fast and noticeably too slow, making the delivery feel less natural and slightly artificial."},{"id":"59d70211-e355-4a44-873a-a98b19034185","tool":"fish-audio","tool_name":"Fish Audio","verdict":"worked","score":null,"score_total":null,"note":"Keeps noisy-source speech sounding human-like rather than robotic: both low-quality outputs were reported as non-AI-sounding and close to the input voice's character."},{"id":"2faea031-eb67-4f6c-b7c8-7258d9b53c0f","tool":"inworld","tool_name":"Inworld","verdict":"worked","score":null,"score_total":null,"note":"The low-quality output still sounded human rather than robotic, coming across as a genuine speaker instead of a synthetic one."},{"id":"a8bdcc87-abfa-4cdb-9967-3dc55de7afb1","tool":"minimax","tool_name":"MiniMax","verdict":"worked","score":null,"score_total":null,"note":"The low-quality run still sounded human rather than robotic or AI-generated, despite the accuracy gap."},{"id":"df45fb93-e306-4fbe-a469-741589f4fd2b","tool":"speechify","tool_name":"Speechify","verdict":"worked","score":null,"score_total":null,"note":"The noisy source still yielded a natural-sounding voice in isolation."},{"id":"b14dd1ff-8fa6-4073-bf38-0250dbcc735e","tool":"topmediai-voice-cloning","tool_name":"TopMediai Voice Cloning","verdict":"struggled","score":null,"score_total":null,"note":"Gen sounds noticeably robotic and lacks emotional depth and natural speech rhythm on the noisy sample."},{"id":"5959899b-bf1b-4519-b6c4-33074f3d30c1","tool":"uberduck","tool_name":"Uberduck","verdict":"failed","score":null,"score_total":null,"note":"The output sounded heavily robotic, with frequent unnatural pauses that made it immediately identifiable as AI-generated."},{"id":"51acec8e-320d-4368-8430-ac7dd23cae86","tool":"vocalai","tool_name":"VocalAI","verdict":"worked","score":null,"score_total":null,"note":"The generated speech sounded natural and human-like, with clean, easy-to-listen-to audio quality despite the weak voice match."}]}