{"observation":{"id":"5d9722ee-5bad-4816-b6b6-0ba863ed2a50","tool":"media-io","tool_name":"Media.io","criterion":"edge-quality","criterion_name":"Edge quality","criterion_definition":"How clean are the cutouts around hair, fingers, and clothing edges; are there visible halo, fringing, or jagged edges?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Clean edges around hair, fingers, and clothing are a core measure of whether the background cutout works well at all. (3 of 3 judges)","scenario":"busy-urban-street","scenario_name":"Busy Urban Street","group_tag":"remove-or-replace-video-backgrounds-using-ai","scenario_description":"A video of a person walking through a busy city street with multiple people, moving vehicles, and a visually complex urban background. It was used to stress segmentation and tracking under heavy background distraction and continuous motion.","modality":"video","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-3-8dd8c54c98be.mp4","role":"input","filename":"Input 3.mp4"}],"stresses":["Complex background segmentation","Handling background distractions","Subject tracking","Temporal consistency across frames","Edge accuracy during continuous movement"],"verdict":"struggled","score":null,"score_total":null,"note":"For moving multi-person footage, jacket, sleeve, and pant-leg boundaries faded gradually into black instead of cutting sharply, leaving a soft feathered outline.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/0122df81cac54b59ab38e07ee86290c2.mp4?v=1","role":"input","alt":"0122df81cac54b59ab38e07ee86290c2.mp4"},{"url":"https://cdn.futuresmart.ai/public/aidemos/eb8789233d434ceaa02c0584fef4e877.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/d8d339aaa5684ac1add4e7eae0c22c8d.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/4cc8b5b6c5ea473bb202bb1be577a550.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/e8576ad6fc8943d484a17a423a087947.mp4?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/f71888caf9ee4f479093d8d5108f9909.mp4?v=1","role":"output","alt":null}],"run_id":"10155228-7ce8-438a-a210-547331ef080b","study_title":"Remove or Replace Video Backgrounds Using AI","study_kind":"generation","research_task":"86ba42c2d","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-3-8dd8c54c98be.mp4","filename":"Input 3.mp4","alt":"Busy Urban Street","role":"input"}],"modality":"video","stresses":["Complex background segmentation","Handling background distractions","Subject tracking","Temporal consistency across frames","Edge accuracy during continuous movement"]},"tool_page_slug":"media-io","tool_url":"https://aidemos.com/tools/media-io","permalink":"https://aidemos.com/evidence/5d9722ee-5bad-4816-b6b6-0ba863ed2a50","api_url":"https://ai.aidemos.com/v1/observations/5d9722ee-5bad-4816-b6b6-0ba863ed2a50"},"peers":[{"id":"f49ba8f7-72d7-4c65-8c57-3debbb3e0d77","tool":"bria-ai","tool_name":"Bria.ai","verdict":"struggled","score":null,"score_total":null,"note":"The cutouts are dim and partially soft-edged, with semi-transparent edge fringing and residue in gaps that should read as pure black.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7bfaf6c02e9c46d48e566faae4432a41.png?v=1","evidence_url":"https://aidemos.com/evidence/f49ba8f7-72d7-4c65-8c57-3debbb3e0d77"},{"id":"dd6eae01-0b7a-4157-833a-59aaa267e034","tool":"cutout-pro","tool_name":"Cutout.Pro","verdict":"struggled","score":null,"score_total":null,"note":"Leaves a residual dark shadow smudge near the feet instead of a clean shoe-to-ground cutoff.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a88c49353e494c64be6a075d8a47dafd.png?v=1","evidence_url":"https://aidemos.com/evidence/dd6eae01-0b7a-4157-833a-59aaa267e034"},{"id":"1e8898e8-9e37-49e1-9512-ea4f8f6a6a9a","tool":"flexclip","tool_name":"FlexClip","verdict":"struggled","score":null,"score_total":null,"note":"The cutout keeps a soft grey-white halo around the beanie and head silhouette, so the edge remains visibly fringed under snowy street conditions.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/5724cb64bd3f4ca8b23f9b1760d1e6e4.png?v=1","evidence_url":"https://aidemos.com/evidence/1e8898e8-9e37-49e1-9512-ea4f8f6a6a9a"},{"id":"093594f3-3468-40f6-bbfd-2185b3caad02","tool":"fotor","tool_name":"Fotor","verdict":"worked","score":null,"score_total":null,"note":"Fur-hood trim and backpack edges stayed clean, with no hard cutout line around the subject.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/d27ac7ac52bd48e4be9f37de63fe5b5b.mp4?v=1","evidence_url":"https://aidemos.com/evidence/093594f3-3468-40f6-bbfd-2185b3caad02"},{"id":"1da27c0b-3c3b-4018-b267-0228a01707a1","tool":"invideo-ai","tool_name":"InVideo AI","verdict":"worked","score":null,"score_total":null,"note":"It maintained clean cutout edges in the low-contrast night scene, with no halo or sky-bleed around the silhouette.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/2a8f5912d1244f47b145c185e08cba33.mp4?v=1","evidence_url":"https://aidemos.com/evidence/1da27c0b-3c3b-4018-b267-0228a01707a1"},{"id":"63520a23-eff2-47d4-a17a-42c1f98c8efe","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"Produces rough subject outlines and backpack-edge artifacts on the multi-person street cutout, rather than a clean silhouette.","artifact_count":5,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b172169ed97a4bc3984d63ccc9590e78.mp4?v=1","evidence_url":"https://aidemos.com/evidence/63520a23-eff2-47d4-a17a-42c1f98c8efe"}],"other_criteria":[{"id":"04f7a761-7012-4add-9893-5c332879dc65","criterion":"hair-and-fine-detail","criterion_name":"Hair and fine detail","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The fuzzy fur trim on the hood lost individual-strand texture and became a soft blurred blob against black.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/04f7a761-7012-4add-9893-5c332879dc65"},{"id":"d69e913b-6a51-4699-ab80-dc8a91fb4e9a","criterion":"lighting-adaptation","criterion_name":"Lighting adaptation","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"A solid-black cutout result still left subjects floating with zero ground contact and no shadow, so the composite reads as pasted in rather than naturally lit.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/d69e913b-6a51-4699-ab80-dc8a91fb4e9a"},{"id":"029b8c65-f8b1-4fcb-9b41-609b00c5f50d","criterion":"motion-handling","criterion_name":"Motion handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The cutout held up as several people shifted position through the frame, including one person moving from center toward the right and others entering at the edges.","artifact_count":4,"evidence_url":"https://aidemos.com/evidence/029b8c65-f8b1-4fcb-9b41-609b00c5f50d"}],"appears_in":[{"page_type":"ranking","slug":"video-background-removers","title":"Best AI Tools to Remove or Replace Video Backgrounds with AI","url":"https://aidemos.com/best/video-background-removers","binding":"run"}],"same_scenario":[{"id":"f49ba8f7-72d7-4c65-8c57-3debbb3e0d77","tool":"bria-ai","tool_name":"Bria.ai","verdict":"struggled","score":null,"score_total":null,"note":"The cutouts are dim and partially soft-edged, with semi-transparent edge fringing and residue in gaps that should read as pure black."},{"id":"dd6eae01-0b7a-4157-833a-59aaa267e034","tool":"cutout-pro","tool_name":"Cutout.Pro","verdict":"struggled","score":null,"score_total":null,"note":"Leaves a residual dark shadow smudge near the feet instead of a clean shoe-to-ground cutoff."},{"id":"1e8898e8-9e37-49e1-9512-ea4f8f6a6a9a","tool":"flexclip","tool_name":"FlexClip","verdict":"struggled","score":null,"score_total":null,"note":"The cutout keeps a soft grey-white halo around the beanie and head silhouette, so the edge remains visibly fringed under snowy street conditions."},{"id":"093594f3-3468-40f6-bbfd-2185b3caad02","tool":"fotor","tool_name":"Fotor","verdict":"worked","score":null,"score_total":null,"note":"Fur-hood trim and backpack edges stayed clean, with no hard cutout line around the subject."},{"id":"1da27c0b-3c3b-4018-b267-0228a01707a1","tool":"invideo-ai","tool_name":"InVideo AI","verdict":"worked","score":null,"score_total":null,"note":"It maintained clean cutout edges in the low-contrast night scene, with no halo or sky-bleed around the silhouette."},{"id":"63520a23-eff2-47d4-a17a-42c1f98c8efe","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"Produces rough subject outlines and backpack-edge artifacts on the multi-person street cutout, rather than a clean silhouette."}]}