{"observation":{"id":"365c8a87-d849-47f7-aa89-ce99901c4058","tool":"flexclip","tool_name":"FlexClip","criterion":"temporal-consistency","criterion_name":"Temporal consistency","criterion_definition":"Does the mask flicker or shift between frames, or stay stable across the clip?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Stable masks across frames are essential in video; flicker or shifting means the background removal is visibly broken. (3 of 3 judges)","scenario":"oregon-coast-walking","scenario_name":"Oregon Coast Walking","group_tag":"remove-or-replace-video-backgrounds-using-ai","scenario_description":"A daylight outdoor video of a single person walking along an Oregon coast beach, with the camera following the subject and ocean waves, sand, and sky visible in the background. It was used to test background removal and replacement on a moving subject in a natural outdoor setting.","modality":"video","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-1-0263564d1ef2.mp4","role":"input","filename":"Input 1.mp4"}],"stresses":["Outdoor background removal","Subject segmentation during movement","Hair and edge preservation","AI background replacement quality"],"verdict":"mixed","score":null,"score_total":null,"note":"The same blue-teal halo is present at multiple sampled timestamps, so the edge defect persists across the clip rather than appearing as a one-frame glitch.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/d262962121824986bcc6f7ed3b4d1c60.png?v=1","role":"output","alt":null}],"run_id":"10155228-7ce8-438a-a210-547331ef080b","study_title":"Remove or Replace Video Backgrounds Using AI","study_kind":"generation","research_task":"86ba42c2d","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-1-0263564d1ef2.mp4","filename":"Input 1.mp4","alt":"Oregon Coast Walking","role":"input"}],"modality":"video","stresses":["Outdoor background removal","Subject segmentation during movement","Hair and edge preservation","AI background replacement quality"]},"tool_page_slug":"flexclip","tool_url":"https://aidemos.com/tools/flexclip","permalink":"https://aidemos.com/evidence/365c8a87-d849-47f7-aa89-ce99901c4058","api_url":"https://ai.aidemos.com/v1/observations/365c8a87-d849-47f7-aa89-ce99901c4058"},"peers":[{"id":"229ebac1-975e-452d-a171-0ebb5b14dc9c","tool":"kapwing","tool_name":"Kapwing","verdict":"failed","score":null,"score_total":null,"note":"The Oregon coast export is only stable for the first part of the file; at 0:05.4 it hard-cuts back to untouched beach footage, so the full 10.6-second result is not temporally consistent as one processed clip.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/0a33a88a140b4edabc0ce9752426ab0a.mp4?v=1","evidence_url":"https://aidemos.com/evidence/229ebac1-975e-452d-a171-0ebb5b14dc9c"}],"other_criteria":[{"id":"bce1923f-6eb3-4da3-8115-ccf184fa8c9d","criterion":"edge-quality","criterion_name":"Edge quality","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Under harsh backlighting, the beach subject’s torso can read semi-transparent instead of fully opaque, so the matte is visibly incomplete beyond the recurring halo artifact.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/bce1923f-6eb3-4da3-8115-ccf184fa8c9d"},{"id":"5265dcc9-7904-44d4-8820-031b5c587416","criterion":"edge-quality","criterion_name":"Edge quality","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Backlit cutouts pick up a recurring blue-teal halo around the head and shoulders instead of a clean silhouette edge.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/5265dcc9-7904-44d4-8820-031b5c587416"},{"id":"1b518c2f-715d-492d-868c-8302e0d999d2","criterion":"motion-handling","criterion_name":"Motion handling","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"A moving leg becomes noticeably softer and blurrier mid-stride, so motion blur adds extra edge softness to the cutout.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/1b518c2f-715d-492d-868c-8302e0d999d2"}],"appears_in":[{"page_type":"ranking","slug":"video-background-removers","title":"Best AI Tools to Remove or Replace Video Backgrounds with AI","url":"https://aidemos.com/best/video-background-removers","binding":"run"}],"same_scenario":[{"id":"229ebac1-975e-452d-a171-0ebb5b14dc9c","tool":"kapwing","tool_name":"Kapwing","verdict":"failed","score":null,"score_total":null,"note":"The Oregon coast export is only stable for the first part of the file; at 0:05.4 it hard-cuts back to untouched beach footage, so the full 10.6-second result is not temporally consistent as one processed clip."}]}