{"observation":{"id":"e928b323-df69-4f9f-9042-9d72294d89f2","tool":"kling-ai","tool_name":"Kling AI","criterion":"scene-sound-relevance","criterion_name":"Scene-Sound Relevance","criterion_definition":"The generated effect matches what is visually happening on screen.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"This directly tests whether the sound effect matches the scene, which is the main reason a user chooses this tool. (3 of 3 judges)","scenario":"bird-nature-video","scenario_name":"Bird/Nature Video","group_tag":"auto-sfx-video-generation","scenario_description":"A video featuring a bird in frame, used to test whether generated chirping or ambient sounds sync to the specific animal and movement shown on screen.","modality":"video","input_text":null,"input_artifact_refs":[],"stresses":["sync accuracy to a visible subject","nature/animal sound matching","avoiding generic ambience that ignores timing","scene-specific audio generation"],"verdict":"struggled","score":null,"score_total":null,"note":"The tool can omit the featured subject’s specific sound at the moment it appears and fall back to generic ambience.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-bird-88b167f7f533.mp4","role":"input","alt":"Bird.mp4"},{"url":"https://d3epheqghktydj.cloudfront.net/kling-ai-kling-ai-bird-chirping-output-1-f90f2a2a825f.mp4","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/kling-ai-kling-ai-bird-chirping-output-2-afa2b7a2a1cb.mp4","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/kling-ai-kling-ai-bird-chirping-output-3-4cb15eb669f1.mp4","role":"output","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/kling-ai-kling-ai-bird-chirping-output-4-561115c82942.mp4","role":"output","alt":null}],"run_id":"90451942-9055-4e8c-85e6-17c773437ed7","study_title":"Automatically Add Relevant Sound Effects to Videos","study_kind":"generation","research_task":"86b84w3x5","tested_at":null,"completeness":"input-and-output","input":{"state":"not-captured","text":null,"files":[],"modality":"video","stresses":["sync accuracy to a visible subject","nature/animal sound matching","avoiding generic ambience that ignores timing","scene-specific audio generation"]},"tool_page_slug":"kling-ai","tool_url":"https://aidemos.com/tools/kling-ai","permalink":"https://aidemos.com/evidence/e928b323-df69-4f9f-9042-9d72294d89f2","api_url":"https://ai.aidemos.com/v1/observations/e928b323-df69-4f9f-9042-9d72294d89f2"},"peers":[{"id":"9e5ee9c7-1f4c-4a91-92e6-0f38876193d7","tool":"fine-voice","tool_name":"Fine Voice","verdict":"mixed","score":60.0,"score_total":100.0,"note":"The tool can add macro-level appropriate ambience, such as forest and bird background audio, but it can also miscalibrate scale so a small bird is rendered with a \"giant creature\"-sounding chirp.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-bird-88b167f7f533.mp4","evidence_url":"https://aidemos.com/evidence/9e5ee9c7-1f4c-4a91-92e6-0f38876193d7"},{"id":"8b1d4819-6025-49a6-a216-1d3c30fa2cbe","tool":"flexclip","tool_name":"FlexClip","verdict":"worked","score":null,"score_total":null,"note":"The tool can add ambient bird-and-forest audio that fits the scene context, even when the chirps themselves remain generic.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-bird-88b167f7f533.mp4","evidence_url":"https://aidemos.com/evidence/8b1d4819-6025-49a6-a216-1d3c30fa2cbe"}],"other_criteria":[{"id":"75407f0b-f13b-4e88-8bc3-8e84da3296a2","criterion":"audio-quality","criterion_name":"Audio Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Prompt assistance can make the output audible and improve volume over the no-prompt baseline.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/75407f0b-f13b-4e88-8bc3-8e84da3296a2"},{"id":"423601f9-0ef6-48b2-8f30-ecbcf9624efe","criterion":"sync-accuracy","criterion_name":"Sync Accuracy","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The subject-specific sound can fail to line up with the object’s on-screen behavior.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/423601f9-0ef6-48b2-8f30-ecbcf9624efe"},{"id":"155aa78a-cdb6-47d7-bec1-215e9b885c2b","criterion":"variant-usefulness","criterion_name":"Variant Usefulness","rank_role":"context","verdict":"mixed","score":null,"score_total":null,"note":"The fourth variant can be only marginally better than the others, so the extra variants provide limited benefit.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/155aa78a-cdb6-47d7-bec1-215e9b885c2b"}],"appears_in":[{"page_type":"ranking","slug":"ai-sound-effect-generators","title":"Best AI Tools to Automatically Add Sound Effects to Videos","url":"https://aidemos.com/best/ai-sound-effect-generators","binding":"run"},{"page_type":"tool","slug":"fine-voice","title":null,"url":"https://aidemos.com/tools/fine-voice","binding":"run"},{"page_type":"tool","slug":"flexclip","title":null,"url":"https://aidemos.com/tools/flexclip","binding":"run"},{"page_type":"tool","slug":"kling-ai","title":null,"url":"https://aidemos.com/tools/kling-ai","binding":"run"},{"page_type":"tool","slug":"mirelo","title":null,"url":"https://aidemos.com/tools/mirelo","binding":"run"}],"same_scenario":[{"id":"9e5ee9c7-1f4c-4a91-92e6-0f38876193d7","tool":"fine-voice","tool_name":"Fine Voice","verdict":"mixed","score":60.0,"score_total":100.0,"note":"The tool can add macro-level appropriate ambience, such as forest and bird background audio, but it can also miscalibrate scale so a small bird is rendered with a \"giant creature\"-sounding chirp."},{"id":"8b1d4819-6025-49a6-a216-1d3c30fa2cbe","tool":"flexclip","tool_name":"FlexClip","verdict":"worked","score":null,"score_total":null,"note":"The tool can add ambient bird-and-forest audio that fits the scene context, even when the chirps themselves remain generic."}]}