{"observation":{"id":"2b999867-72e5-42be-9c1e-e117327ba4d0","tool":"cvparserpro","tool_name":"CVParserPro","criterion":"accuracy","criterion_name":"Accuracy","criterion_definition":"Are extracted values correct and complete?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Correct and complete values are the essence of resume parsing, so this directly determines whether the tool succeeds. (3 of 3 judges)","scenario":"multi-column-sidebar-resume-priya-sharma","scenario_name":"Multi-column sidebar resume — Priya Sharma","group_tag":"resume-parsing","scenario_description":"A two-column sidebar resume for Priya Sharma, used to test whether parsers can preserve reading order and correctly extract content split across columns.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","role":"input"}],"stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"],"verdict":"failed","score":null,"score_total":null,"note":"The experience calculation undercounted the candidate badly, showing 2 years even though the report says the resume reflects about 6.5 years of experience.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/cvparserpro-p4-2years-8330234cdffb.png","role":"output","alt":null}],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","filename":"parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","alt":"Multi-column sidebar resume — Priya Sharma","role":"input"}],"modality":"pdf","stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"]},"tool_page_slug":"cvparserpro","tool_url":"https://aidemos.com/tools/cvparserpro","permalink":"https://aidemos.com/evidence/2b999867-72e5-42be-9c1e-e117327ba4d0","api_url":"https://ai.aidemos.com/v1/observations/2b999867-72e5-42be-9c1e-e117327ba4d0"},"peers":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-3dccf1e09941.png","evidence_url":"https://aidemos.com/evidence/cca7d6cc-f728-4cb2-90cc-acfaf4950c07"},{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/34d1c690-6d2f-40d4-862e-9abb5393a23d"},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-aa9cc0c96107.png","evidence_url":"https://aidemos.com/evidence/882018cc-18b9-49e9-8468-4edafdf5dcf8"},{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-dfe47b81f568.png","evidence_url":"https://aidemos.com/evidence/f2b469da-80ba-491b-a014-c931df0c4e10"},{"id":"1a1cbbe6-4c52-4ee3-a44b-e6725d653493","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The multi-column resume's name, email, phone, LinkedIn URL, location, and job title headline were extracted correctly.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-5135e1c903e9.png","evidence_url":"https://aidemos.com/evidence/1a1cbbe6-4c52-4ee3-a44b-e6725d653493"},{"id":"a0cec795-28b6-40a0-b5bf-99335109a788","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Misclassifies the job-title headline as Summary, returning 'Software Engineer — Machine Learning' instead of a profile summary.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/openresume-o4-summary-wrong-1197c353ecbe.png","evidence_url":"https://aidemos.com/evidence/a0cec795-28b6-40a0-b5bf-99335109a788"},{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skima-ai-04-truncated-input2-2aee29b8947f.png","evidence_url":"https://aidemos.com/evidence/d4316b90-c863-4d4b-a487-00a3eb8bd038"}],"other_criteria":[{"id":"96469fe3-81c8-438f-b3ec-5a842ed0413e","criterion":"multi-column-handling","criterion_name":"Multi-column handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The two-column sidebar resume was parsed without layout configuration, and content from both columns was retained well enough to extract the sidebar languages and the main work history.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/96469fe3-81c8-438f-b3ec-5a842ed0413e"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Tools for Parsing Resumes via API (2026)","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value."},{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency."},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section."},{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'."},{"id":"1a1cbbe6-4c52-4ee3-a44b-e6725d653493","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The multi-column resume's name, email, phone, LinkedIn URL, location, and job title headline were extracted correctly."},{"id":"a0cec795-28b6-40a0-b5bf-99335109a788","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Misclassifies the job-title headline as Summary, returning 'Software Engineer — Machine Learning' instead of a profile summary."},{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'"}]}