{"observation":{"id":"d69e913b-6a51-4699-ab80-dc8a91fb4e9a","tool":"media-io","tool_name":"Media.io","criterion":"lighting-adaptation","criterion_name":"Lighting adaptation","criterion_definition":"Does the replaced background look naturally lit relative to the subject, or obviously composited?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If the replaced background does not match the subject’s lighting, the composite looks fake, so this is central to replacement quality. (3 of 3 judges)","scenario":"busy-urban-street","scenario_name":"Busy Urban Street","group_tag":"remove-or-replace-video-backgrounds-using-ai","scenario_description":"A video of a person walking through a busy city street with multiple people, moving vehicles, and a visually complex urban background. It was used to stress segmentation and tracking under heavy background distraction and continuous motion.","modality":"video","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-3-8dd8c54c98be.mp4","role":"input","filename":"Input 3.mp4"}],"stresses":["Complex background segmentation","Handling background distractions","Subject tracking","Temporal consistency across frames","Edge accuracy during continuous movement"],"verdict":"struggled","score":null,"score_total":null,"note":"A solid-black cutout result still left subjects floating with zero ground contact and no shadow, so the composite reads as pasted in rather than naturally lit.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/0122df81cac54b59ab38e07ee86290c2.mp4?v=1","role":"input","alt":"0122df81cac54b59ab38e07ee86290c2.mp4"},{"url":"https://cdn.futuresmart.ai/public/aidemos/a8f0c9049777490c900ad58fc8968f83.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/4cc8b5b6c5ea473bb202bb1be577a550.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/e8576ad6fc8943d484a17a423a087947.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/f71888caf9ee4f479093d8d5108f9909.mp4?v=1","role":"output","alt":null}],"run_id":"10155228-7ce8-438a-a210-547331ef080b","study_title":"Remove or Replace Video Backgrounds Using AI","study_kind":"generation","research_task":"86ba42c2d","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-3-8dd8c54c98be.mp4","filename":"Input 3.mp4","alt":"Busy Urban Street","role":"input"}],"modality":"video","stresses":["Complex background segmentation","Handling background distractions","Subject tracking","Temporal consistency across frames","Edge accuracy during continuous movement"]},"tool_page_slug":"media-io","tool_url":"https://aidemos.com/tools/media-io","permalink":"https://aidemos.com/evidence/d69e913b-6a51-4699-ab80-dc8a91fb4e9a","api_url":"https://ai.aidemos.com/v1/observations/d69e913b-6a51-4699-ab80-dc8a91fb4e9a"},"peers":[{"id":"87e47faa-5505-4f29-95c7-726fa54b39c2","tool":"descript","tool_name":"Descript","verdict":"struggled","score":null,"score_total":null,"note":"The warm lantern-lit alley does not wrap light onto the subjects: jacket edges still read as flat daylight with no warm rim light.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6a8040044a0642c6aca95cc1b0ffb03c.png?v=1","evidence_url":"https://aidemos.com/evidence/87e47faa-5505-4f29-95c7-726fa54b39c2"}],"other_criteria":[{"id":"5d9722ee-5bad-4816-b6b6-0ba863ed2a50","criterion":"edge-quality","criterion_name":"Edge quality","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"For moving multi-person footage, jacket, sleeve, and pant-leg boundaries faded gradually into black instead of cutting sharply, leaving a soft feathered outline.","artifact_count":6,"evidence_url":"https://aidemos.com/evidence/5d9722ee-5bad-4816-b6b6-0ba863ed2a50"},{"id":"04f7a761-7012-4add-9893-5c332879dc65","criterion":"hair-and-fine-detail","criterion_name":"Hair and fine detail","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The fuzzy fur trim on the hood lost individual-strand texture and became a soft blurred blob against black.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/04f7a761-7012-4add-9893-5c332879dc65"},{"id":"029b8c65-f8b1-4fcb-9b41-609b00c5f50d","criterion":"motion-handling","criterion_name":"Motion handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The cutout held up as several people shifted position through the frame, including one person moving from center toward the right and others entering at the edges.","artifact_count":4,"evidence_url":"https://aidemos.com/evidence/029b8c65-f8b1-4fcb-9b41-609b00c5f50d"}],"appears_in":[{"page_type":"ranking","slug":"video-background-removers","title":"Best AI Tools to Remove or Replace Video Backgrounds with AI","url":"https://aidemos.com/best/video-background-removers","binding":"run"}],"same_scenario":[{"id":"87e47faa-5505-4f29-95c7-726fa54b39c2","tool":"descript","tool_name":"Descript","verdict":"struggled","score":null,"score_total":null,"note":"The warm lantern-lit alley does not wrap light onto the subjects: jacket edges still read as flat daylight with no warm rim light."}]}