{"observation":{"id":"815ae4c3-0847-4305-8534-499da85fa491","tool":"descript","tool_name":"Descript","criterion":"edge-quality","criterion_name":"Edge quality","criterion_definition":"How clean are the cutouts around hair, fingers, and clothing edges; are there visible halo, fringing, or jagged edges?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Clean edges around hair, fingers, and clothing are a core measure of whether the background cutout works well at all. (3 of 3 judges)","scenario":"indoor-talking-head","scenario_name":"Indoor Talking Head","group_tag":"remove-or-replace-video-backgrounds-using-ai","scenario_description":"An indoor talking-head video of a person speaking directly to the camera with a static background, natural hand gestures, and facial expressions. It was used to test how well tools preserve the subject while replacing an indoor background.","modality":"video","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-2-0e8b7fa1a596.mp4","role":"input","filename":"Input 2.mp4"}],"stresses":["Static camera performance","Face and body segmentation","Facial expression preservation","Background replacement accuracy in an indoor environment"],"verdict":"struggled","score":null,"score_total":null,"note":"The shoulder matte is feathered and desaturated compared with the surrounding fabric, leaving a visible rough cutout edge.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/b2042b285272404c8008f22bfb2c6a4a.png?v=1","role":"output","alt":null}],"run_id":"10155228-7ce8-438a-a210-547331ef080b","study_title":"Remove or Replace Video Backgrounds Using AI","study_kind":"generation","research_task":"86ba42c2d","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/remove-or-replace-video-backgrounds-usin-input-2-0e8b7fa1a596.mp4","filename":"Input 2.mp4","alt":"Indoor Talking Head","role":"input"}],"modality":"video","stresses":["Static camera performance","Face and body segmentation","Facial expression preservation","Background replacement accuracy in an indoor environment"]},"tool_page_slug":"descript","tool_url":"https://aidemos.com/tools/descript","permalink":"https://aidemos.com/evidence/815ae4c3-0847-4305-8534-499da85fa491","api_url":"https://ai.aidemos.com/v1/observations/815ae4c3-0847-4305-8534-499da85fa491"},"peers":[{"id":"4407ea51-e461-4c18-b4c6-632dddca4582","tool":"bria-ai","tool_name":"Bria.ai","verdict":"struggled","score":null,"score_total":null,"note":"A soft blue-ish fringe remains around the hair and jawline against the black background, indicating visible edge haloing.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/bb42d14851df4b24b60a5e41a3a988fe.png?v=1","evidence_url":"https://aidemos.com/evidence/4407ea51-e461-4c18-b4c6-632dddca4582"},{"id":"fa791a3c-518d-41e7-861e-b5f102a8dd20","tool":"cutout-pro","tool_name":"Cutout.Pro","verdict":"struggled","score":null,"score_total":null,"note":"Cuts the sleeves inconsistently at the frame boundary, so left and right sleeve edges do not line up across timestamps.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/54469cfe20514b9ea8dcf36e878931af.png?v=1","evidence_url":"https://aidemos.com/evidence/fa791a3c-518d-41e7-861e-b5f102a8dd20"},{"id":"cc65dc16-00d8-4da9-82c6-f44722d0961a","tool":"fotor","tool_name":"Fotor","verdict":"worked","score":null,"score_total":null,"note":"The subject's outline is matted cleanly, with no obvious tearing or missing chunks around the silhouette.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/180e2c765f5d48aea4b60b93bc4b1310.mp4?v=1","evidence_url":"https://aidemos.com/evidence/cc65dc16-00d8-4da9-82c6-f44722d0961a"},{"id":"3ca44948-0ba2-4ed5-938b-6d3dda14d259","tool":"invideo-ai","tool_name":"InVideo AI","verdict":"worked","score":null,"score_total":null,"note":"It preserved hair and clothing edges cleanly against the replacement set, with no visible halo on close inspection.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/26e86b41c14c48d394fcd4b01fec4c66.mp4?v=1","evidence_url":"https://aidemos.com/evidence/3ca44948-0ba2-4ed5-938b-6d3dda14d259"},{"id":"f72942b3-9f8a-46c9-96d0-9405cd07cbea","tool":"kapwing","tool_name":"Kapwing","verdict":"worked","score":null,"score_total":null,"note":"On the indoor talking-head clip, the cutout stays crisp with no visible fringing or color halo.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b56d41fb19e74c0597f8f3e3e16d7060.png?v=1","evidence_url":"https://aidemos.com/evidence/f72942b3-9f8a-46c9-96d0-9405cd07cbea"},{"id":"3b5d1009-49a9-4f42-a8ec-fcf316bfcaee","tool":"picsart","tool_name":"Picsart","verdict":"mixed","score":null,"score_total":null,"note":"The indoor talking-head cutout was clean overall, but a faint purple/blue fringe still lingered along the shoulder and collar boundary.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ef797a3a7cb84a04b0ef00989d5322fc.png?v=1","evidence_url":"https://aidemos.com/evidence/3b5d1009-49a9-4f42-a8ec-fcf316bfcaee"},{"id":"2c2f922b-5f3e-4ad6-8f05-23dbc602b9e7","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"Keeps the subject isolated but leaves visible edge artifacts around the hair and shoulders on the talking-head cutout.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/dfa254fe0189444886a119de2d6e6f1e.mp4?v=1","evidence_url":"https://aidemos.com/evidence/2c2f922b-5f3e-4ad6-8f05-23dbc602b9e7"}],"other_criteria":[{"id":"636fb6c4-509b-4576-8679-cdaf9b56177a","criterion":"hair-and-fine-detail","criterion_name":"Hair and fine detail","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Fine hair detail softens into a halo/blur band around the crown and sides, and flyaway strands are lost against the new background.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/636fb6c4-509b-4576-8679-cdaf9b56177a"},{"id":"69240bb5-8766-4fbb-9a67-aa46dbf15bc4","criterion":"lighting-adaptation","criterion_name":"Lighting adaptation","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"The subject keeps flat neutral lighting instead of picking up the new room’s warm or cool color spill, so the composite reads less naturally lit.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/69240bb5-8766-4fbb-9a67-aa46dbf15bc4"},{"id":"74e15c82-514d-483b-bce2-15ba2a3e9488","criterion":"output-resolution","criterion_name":"Output resolution","rank_role":"context","verdict":"failed","score":null,"score_total":null,"note":"It converts a 3840×2160 landscape source into a 720×1280 portrait export, changing orientation as well as downscaling.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/74e15c82-514d-483b-bce2-15ba2a3e9488"}],"appears_in":[{"page_type":"ranking","slug":"video-background-removers","title":"Best AI Tools to Remove or Replace Video Backgrounds with AI","url":"https://aidemos.com/best/video-background-removers","binding":"run"}],"same_scenario":[{"id":"4407ea51-e461-4c18-b4c6-632dddca4582","tool":"bria-ai","tool_name":"Bria.ai","verdict":"struggled","score":null,"score_total":null,"note":"A soft blue-ish fringe remains around the hair and jawline against the black background, indicating visible edge haloing."},{"id":"fa791a3c-518d-41e7-861e-b5f102a8dd20","tool":"cutout-pro","tool_name":"Cutout.Pro","verdict":"struggled","score":null,"score_total":null,"note":"Cuts the sleeves inconsistently at the frame boundary, so left and right sleeve edges do not line up across timestamps."},{"id":"cc65dc16-00d8-4da9-82c6-f44722d0961a","tool":"fotor","tool_name":"Fotor","verdict":"worked","score":null,"score_total":null,"note":"The subject's outline is matted cleanly, with no obvious tearing or missing chunks around the silhouette."},{"id":"3ca44948-0ba2-4ed5-938b-6d3dda14d259","tool":"invideo-ai","tool_name":"InVideo AI","verdict":"worked","score":null,"score_total":null,"note":"It preserved hair and clothing edges cleanly against the replacement set, with no visible halo on close inspection."},{"id":"f72942b3-9f8a-46c9-96d0-9405cd07cbea","tool":"kapwing","tool_name":"Kapwing","verdict":"worked","score":null,"score_total":null,"note":"On the indoor talking-head clip, the cutout stays crisp with no visible fringing or color halo."},{"id":"3b5d1009-49a9-4f42-a8ec-fcf316bfcaee","tool":"picsart","tool_name":"Picsart","verdict":"mixed","score":null,"score_total":null,"note":"The indoor talking-head cutout was clean overall, but a faint purple/blue fringe still lingered along the shoulder and collar boundary."},{"id":"2c2f922b-5f3e-4ad6-8f05-23dbc602b9e7","tool":"veed","tool_name":"VEED","verdict":"struggled","score":null,"score_total":null,"note":"Keeps the subject isolated but leaves visible edge artifacts around the hair and shoulders on the talking-head cutout."}]}