{"observation":{"id":"106ac9d9-ab64-4bc2-be82-1fae076acd2c","tool":"noise-remover","tool_name":"Noise Remover","criterion":"voice-preservation","criterion_name":"Voice preservation","criterion_definition":"After cleanup, does the voice still sound natural, or hollow, robotic, underwater, or artifacted?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Noise cleanup is only useful if the speech still sounds natural and intelligible after processing. (3 of 3 judges)","scenario":"indoor-air-conditioner-noise","scenario_name":"Indoor Air Conditioner Noise","group_tag":"background-noise-removal","scenario_description":"A real-world indoor speech recording with a single continuous HVAC/air-conditioner noise source. It is designed to test speech isolation and noise reduction when the background noise is predictable and steady.","modality":"audio","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/remove-background-noise-from-audio-and-v-ai-direction-ac-on-fan-off-noise-from-no-cc3485214a73.wav","role":"input","filename":"Ai direction ac on fan off noise from noise.wav"}],"stresses":["Removal of continuous HVAC noise","Speech preservation with steady background noise","Natural voice quality retention","Background noise reduction with minimal cleanup"],"verdict":"mixed","score":null,"score_total":null,"note":"The speech generally stays natural, but the tool introduces two volume dips around 0:20 and 0:24-0:25, which harms voice consistency.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/f1db12dbbe1c4965a66ec72705b29f7c.wav?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/0a9210c423a14aefac0c8298aaa455f4.wav?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/325a0b38e8694bb5a5c6db4c765bfcfd.wav?v=1","role":"context","alt":null}],"run_id":"189e3005-33f2-4481-924e-334542fcda87","study_title":"Remove Background Noise from Audio and Video Recordings Using AI","study_kind":"generation","research_task":"86ba6cyhe","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/remove-background-noise-from-audio-and-v-ai-direction-ac-on-fan-off-noise-from-no-cc3485214a73.wav","filename":"Ai direction ac on fan off noise from noise.wav","alt":"Indoor Air Conditioner Noise","role":"input"}],"modality":"audio","stresses":["Removal of continuous HVAC noise","Speech preservation with steady background noise","Natural voice quality retention","Background noise reduction with minimal cleanup"]},"tool_page_slug":"noise-remover","tool_url":"https://aidemos.com/tools/noise-remover","permalink":"https://aidemos.com/evidence/106ac9d9-ab64-4bc2-be82-1fae076acd2c","api_url":"https://ai.aidemos.com/v1/observations/106ac9d9-ab64-4bc2-be82-1fae076acd2c"},"peers":[{"id":"cb4e1fdc-e0ea-45da-87c6-bb6a8d67762d","tool":"adobe-podcast-enhance","tool_name":"Adobe Podcast Enhance","verdict":"struggled","score":null,"score_total":null,"note":"Speech remained understandable, but the original voice tone and character were noticeably altered and the voice quality was not preserved well.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/93123911c7cf4abdbe494bcd75f98c33.wav?v=1","evidence_url":"https://aidemos.com/evidence/cb4e1fdc-e0ea-45da-87c6-bb6a8d67762d"},{"id":"112debde-845e-4c27-9a89-2867135f970a","tool":"audo-studio","tool_name":"Audo Studio","verdict":"worked","score":null,"score_total":null,"note":"The speaker’s voice stays natural and clear, without robotic, metallic, or overly processed artifacts.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/cbeebfb0822a4a988f926ca8637b5c0c.mp3?v=1","evidence_url":"https://aidemos.com/evidence/112debde-845e-4c27-9a89-2867135f970a"},{"id":"dd00b174-0078-4c8b-8295-32b517a9daab","tool":"cleanvoice","tool_name":"Cleanvoice","verdict":"struggled","score":null,"score_total":null,"note":"Preserves intelligibility, but the cleaned speech sounds artificial and somewhat robotic, with the speaker’s natural voice characteristics no longer well preserved.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a6786c3ec1214848906b37561e6ae321.wav?v=1","evidence_url":"https://aidemos.com/evidence/dd00b174-0078-4c8b-8295-32b517a9daab"},{"id":"164c7b1b-6618-45df-92e9-882a5a7a6622","tool":"elevenlabs-voice-isolator","tool_name":"ElevenLabs Voice Isolator","verdict":"worked","score":null,"score_total":null,"note":"The speaker's voice stayed natural and clear, with no significant distortion, robotic artifacts, or unnatural tone changes.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7f10b8ea0cb8448cb1583a91fb79b082.mp3?v=1","evidence_url":"https://aidemos.com/evidence/164c7b1b-6618-45df-92e9-882a5a7a6622"}],"other_criteria":[{"id":"392c10dd-bf01-4331-bd67-cc47742ff1ea","criterion":"handling-different-noise-types","criterion_name":"Handling different noise types","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Reduces steady AC and hiss well, but struggles when noise and speech overlap closely, leaving residual background sound and a volume-dip artifact.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/392c10dd-bf01-4331-bd67-cc47742ff1ea"},{"id":"98d10821-92fa-48e7-8803-9360deb559e9","criterion":"noise-removal-effectiveness","criterion_name":"Noise removal effectiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Removes AC and hiss noise, but some background noise is still audible around 0:07-0:08 in the cleaned result.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/98d10821-92fa-48e7-8803-9360deb559e9"}],"appears_in":[{"page_type":"ranking","slug":"background-noise-removal","title":"Best AI Tools to Remove Background Noise from Audio and Video Recordings","url":"https://aidemos.com/best/background-noise-removal","binding":"run"}],"same_scenario":[{"id":"cb4e1fdc-e0ea-45da-87c6-bb6a8d67762d","tool":"adobe-podcast-enhance","tool_name":"Adobe Podcast Enhance","verdict":"struggled","score":null,"score_total":null,"note":"Speech remained understandable, but the original voice tone and character were noticeably altered and the voice quality was not preserved well."},{"id":"112debde-845e-4c27-9a89-2867135f970a","tool":"audo-studio","tool_name":"Audo Studio","verdict":"worked","score":null,"score_total":null,"note":"The speaker’s voice stays natural and clear, without robotic, metallic, or overly processed artifacts."},{"id":"dd00b174-0078-4c8b-8295-32b517a9daab","tool":"cleanvoice","tool_name":"Cleanvoice","verdict":"struggled","score":null,"score_total":null,"note":"Preserves intelligibility, but the cleaned speech sounds artificial and somewhat robotic, with the speaker’s natural voice characteristics no longer well preserved."},{"id":"164c7b1b-6618-45df-92e9-882a5a7a6622","tool":"elevenlabs-voice-isolator","tool_name":"ElevenLabs Voice Isolator","verdict":"worked","score":null,"score_total":null,"note":"The speaker's voice stayed natural and clear, with no significant distortion, robotic artifacts, or unnatural tone changes."}]}