{"observation":{"id":"91b76f1f-a633-4bd3-854f-a5cec4c621df","tool":"cleanvoice","tool_name":"Cleanvoice","criterion":"handling-different-noise-types","criterion_name":"Handling different noise types","criterion_definition":"Does the tool perform equally well on steady noise like fan hum, intermittent noise like dog barking or door slamming, and overlapping speech?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Real recordings contain different noise patterns, so performance across hum, barking, slams, and overlapping speech is part of the main task. (3 of 3 judges)","scenario":"outdoor-balcony-birds-vehicles-and-surrounding-noise","scenario_name":"Outdoor Balcony Birds, Vehicles, and Surrounding Noise","group_tag":"background-noise-removal","scenario_description":"A real-world outdoor speech recording captured on a balcony with variable environmental noise such as birds and traffic. It is designed to test performance on more dynamic, unpredictable background sound.","modality":"audio","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/remove-background-noise-from-audio-and-v-outside-in-balcony-birds-vehicles-and-su-56b20f611781.wav","role":"input","filename":"Outside in balcony birds vehicles and surrounding noise.wav"}],"stresses":["Suppression of variable outdoor environmental noise","Speech preservation in changing acoustic conditions","Reduction of birds and vehicle traffic sounds","Overall enhancement of noisy field recordings"],"verdict":"mixed","score":null,"score_total":null,"note":"Handles continuous environmental noise such as birds and outdoor ambience better than transient contact noise, but performance varies by noise type and degrades on chair movement sounds.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/5cc2bc944d684a23b09413c7b53bbd99.wav?v=1","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-outside-in-balcony-birds-vehicles-and-su-a72658f8e90c.wav","role":"input","alt":null}],"run_id":"189e3005-33f2-4481-924e-334542fcda87","study_title":"Remove Background Noise from Audio and Video Recordings Using AI","study_kind":"generation","research_task":"86ba6cyhe","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/remove-background-noise-from-audio-and-v-outside-in-balcony-birds-vehicles-and-su-56b20f611781.wav","filename":"Outside in balcony birds vehicles and surrounding noise.wav","alt":"Outdoor Balcony Birds, Vehicles, and Surrounding Noise","role":"input"}],"modality":"audio","stresses":["Suppression of variable outdoor environmental noise","Speech preservation in changing acoustic conditions","Reduction of birds and vehicle traffic sounds","Overall enhancement of noisy field recordings"]},"tool_page_slug":"cleanvoice","tool_url":"https://aidemos.com/tools/cleanvoice","permalink":"https://aidemos.com/evidence/91b76f1f-a633-4bd3-854f-a5cec4c621df","api_url":"https://ai.aidemos.com/v1/observations/91b76f1f-a633-4bd3-854f-a5cec4c621df"},"peers":[{"id":"a2f42010-37b2-40ee-90f4-7d73ea84ae71","tool":"adobe-podcast-enhance","tool_name":"Adobe Podcast Enhance","verdict":"worked","score":null,"score_total":null,"note":"It handled multiple environmental noise types in one pass, including chair movement, wind/air, and bird chirping.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/3b0fcb27834e4421be4fb48f33adedba.wav?v=1","evidence_url":"https://aidemos.com/evidence/a2f42010-37b2-40ee-90f4-7d73ea84ae71"},{"id":"53e111d1-d27c-48c5-a7c3-9aa2b5fa1740","tool":"audo-studio","tool_name":"Audo Studio","verdict":"mixed","score":null,"score_total":null,"note":"The tool handles environmental ambience and bird noise well, but it is less effective on sudden transient sounds such as chair movement.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6a58679998ba40219e823ef829055744.mp3?v=1","evidence_url":"https://aidemos.com/evidence/53e111d1-d27c-48c5-a7c3-9aa2b5fa1740"},{"id":"5a55014a-5ac0-43da-bd81-18c174067536","tool":"auphonic","tool_name":"Auphonic","verdict":"mixed","score":null,"score_total":null,"note":"The tool handled continuous outdoor ambience and bird chirping effectively, but it struggled with transient mechanical noise from chair movement.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/fd2f9af51d4448f1bc258b498240f2ba.mp4?v=1","evidence_url":"https://aidemos.com/evidence/5a55014a-5ac0-43da-bd81-18c174067536"},{"id":"01a4e094-0b2d-49f8-896b-acd0dff6297a","tool":"elevenlabs-voice-isolator","tool_name":"ElevenLabs Voice Isolator","verdict":"worked","score":null,"score_total":null,"note":"It handled environmental noise, object-movement noise, and continuous ambient air/wind noise effectively in the same recording.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/62d47aca3a5644e984498ef476e55e58.mp3?v=1","evidence_url":"https://aidemos.com/evidence/01a4e094-0b2d-49f8-896b-acd0dff6297a"},{"id":"be460c83-01dd-4056-9c95-829069630f8d","tool":"noise-remover","tool_name":"Noise Remover","verdict":"mixed","score":null,"score_total":null,"note":"Handles wind/air and bird chirping well, but only partially suppresses a short chair/creak transient near the start.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/9aa3a83df8db40d2bb69416efd1ad768.wav?v=1","evidence_url":"https://aidemos.com/evidence/be460c83-01dd-4056-9c95-829069630f8d"}],"other_criteria":[{"id":"61be1fda-bdad-4e71-b741-48238f9e778e","criterion":"noise-removal-effectiveness","criterion_name":"Noise removal effectiveness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Removes several outdoor background noises, including ambient noise and bird chirping around 0:17, but does not fully suppress transient chair noise at the start of the recording.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/61be1fda-bdad-4e71-b741-48238f9e778e"},{"id":"a9748451-a180-4cc9-93e9-14c88744e046","criterion":"voice-preservation","criterion_name":"Voice preservation","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Significantly alters the speaker’s tone and voice characteristics, so the cleaned output sounds less natural than the source audio.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/a9748451-a180-4cc9-93e9-14c88744e046"}],"appears_in":[{"page_type":"ranking","slug":"background-noise-removal","title":"Best AI Tools to Remove Background Noise from Audio and Video Recordings","url":"https://aidemos.com/best/background-noise-removal","binding":"run"}],"same_scenario":[{"id":"a2f42010-37b2-40ee-90f4-7d73ea84ae71","tool":"adobe-podcast-enhance","tool_name":"Adobe Podcast Enhance","verdict":"worked","score":null,"score_total":null,"note":"It handled multiple environmental noise types in one pass, including chair movement, wind/air, and bird chirping."},{"id":"53e111d1-d27c-48c5-a7c3-9aa2b5fa1740","tool":"audo-studio","tool_name":"Audo Studio","verdict":"mixed","score":null,"score_total":null,"note":"The tool handles environmental ambience and bird noise well, but it is less effective on sudden transient sounds such as chair movement."},{"id":"5a55014a-5ac0-43da-bd81-18c174067536","tool":"auphonic","tool_name":"Auphonic","verdict":"mixed","score":null,"score_total":null,"note":"The tool handled continuous outdoor ambience and bird chirping effectively, but it struggled with transient mechanical noise from chair movement."},{"id":"01a4e094-0b2d-49f8-896b-acd0dff6297a","tool":"elevenlabs-voice-isolator","tool_name":"ElevenLabs Voice Isolator","verdict":"worked","score":null,"score_total":null,"note":"It handled environmental noise, object-movement noise, and continuous ambient air/wind noise effectively in the same recording."},{"id":"be460c83-01dd-4056-9c95-829069630f8d","tool":"noise-remover","tool_name":"Noise Remover","verdict":"mixed","score":null,"score_total":null,"note":"Handles wind/air and bird chirping well, but only partially suppresses a short chair/creak transient near the start."}]}