{"observation":{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","criterion":"accuracy","criterion_name":"Accuracy","criterion_definition":"Are extracted values correct and complete?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Correct and complete values are the essence of resume parsing, so this directly determines whether the tool succeeds. (3 of 3 judges)","scenario":"multi-column-sidebar-resume-priya-sharma","scenario_name":"Multi-column sidebar resume — Priya Sharma","group_tag":"resume-parsing","scenario_description":"A two-column sidebar resume for Priya Sharma, used to test whether parsers can preserve reading order and correctly extract content split across columns.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","role":"input"}],"stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"],"verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/skima-ai-04-truncated-input2-2aee29b8947f.png","role":"output","alt":null}],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","filename":"parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","alt":"Multi-column sidebar resume — Priya Sharma","role":"input"}],"modality":"pdf","stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"]},"tool_page_slug":"skima-ai","tool_url":"https://aidemos.com/tools/skima-ai","permalink":"https://aidemos.com/evidence/d4316b90-c863-4d4b-a487-00a3eb8bd038","api_url":"https://ai.aidemos.com/v1/observations/d4316b90-c863-4d4b-a487-00a3eb8bd038"},"peers":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-3dccf1e09941.png","evidence_url":"https://aidemos.com/evidence/cca7d6cc-f728-4cb2-90cc-acfaf4950c07"},{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/34d1c690-6d2f-40d4-862e-9abb5393a23d"},{"id":"38e7e96c-ca4c-49f1-a707-df05917e3329","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"mixed","score":null,"score_total":null,"note":"The certification entries were returned without issuing organizations, so the parser dropped issuer data for both certificates.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/cvparserpro-p6-cert-orgs-missing-a86ef2b92516.png","evidence_url":"https://aidemos.com/evidence/38e7e96c-ca4c-49f1-a707-df05917e3329"},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-aa9cc0c96107.png","evidence_url":"https://aidemos.com/evidence/882018cc-18b9-49e9-8468-4edafdf5dcf8"},{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-dfe47b81f568.png","evidence_url":"https://aidemos.com/evidence/f2b469da-80ba-491b-a014-c931df0c4e10"},{"id":"1a1cbbe6-4c52-4ee3-a44b-e6725d653493","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The multi-column resume's name, email, phone, LinkedIn URL, location, and job title headline were extracted correctly.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-5135e1c903e9.png","evidence_url":"https://aidemos.com/evidence/1a1cbbe6-4c52-4ee3-a44b-e6725d653493"},{"id":"a0cec795-28b6-40a0-b5bf-99335109a788","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Misclassifies the job-title headline as Summary, returning 'Software Engineer — Machine Learning' instead of a profile summary.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/openresume-o4-summary-wrong-1197c353ecbe.png","evidence_url":"https://aidemos.com/evidence/a0cec795-28b6-40a0-b5bf-99335109a788"}],"other_criteria":[{"id":"1cf56ab8-34c3-4b84-80ce-c5ee89e1d790","criterion":"field-coverage","criterion_name":"Field coverage","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The parser extracted the basic identity and work-history fields, but it did not fully return the core six-field resume set because skills from the sidebar were missing.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/1cf56ab8-34c3-4b84-80ce-c5ee89e1d790"},{"id":"138b0a76-2a81-4a72-9bb1-a3a5bc425e98","criterion":"multi-column-handling","criterion_name":"Multi-column handling","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"On the two-column sidebar layout, the parser lost the entire right-side sidebar block, so skills, certifications, and languages were not preserved in reading order.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/138b0a76-2a81-4a72-9bb1-a3a5bc425e98"},{"id":"161e513d-c61e-466c-a3e5-47779ac96b21","criterion":"output-quality","criterion_name":"Output quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The two-column output was only moderately usable: core contact and work-history fields were present, but sidebar skills/certifications/languages, projects, and GPA were missing or poorly handled.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/161e513d-c61e-466c-a3e5-47779ac96b21"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Tools for Parsing Resumes via API (2026)","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value."},{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency."},{"id":"38e7e96c-ca4c-49f1-a707-df05917e3329","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"mixed","score":null,"score_total":null,"note":"The certification entries were returned without issuing organizations, so the parser dropped issuer data for both certificates."},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section."},{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'."},{"id":"1a1cbbe6-4c52-4ee3-a44b-e6725d653493","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The multi-column resume's name, email, phone, LinkedIn URL, location, and job title headline were extracted correctly."},{"id":"a0cec795-28b6-40a0-b5bf-99335109a788","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Misclassifies the job-title headline as Summary, returning 'Software Engineer — Machine Learning' instead of a profile summary."}]}