{"observation":{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","criterion":"accuracy","criterion_name":"Accuracy","criterion_definition":"Are extracted values correct and complete?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Correct and complete values are the essence of resume parsing, so this directly determines whether the tool succeeds. (3 of 3 judges)","scenario":"multi-column-sidebar-resume-priya-sharma","scenario_name":"Multi-column sidebar resume — Priya Sharma","group_tag":"resume-parsing","scenario_description":"A two-column sidebar resume for Priya Sharma, used to test whether parsers can preserve reading order and correctly extract content split across columns.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","role":"input"}],"stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"],"verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-image-dfe47b81f568.png","role":"input","alt":null}],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-only","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","filename":"parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","alt":"Multi-column sidebar resume — Priya Sharma","role":"input"}],"modality":"pdf","stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"]},"tool_page_slug":"hrflow","tool_url":"https://aidemos.com/tools/hrflow","permalink":"https://aidemos.com/evidence/f2b469da-80ba-491b-a014-c931df0c4e10","api_url":"https://ai.aidemos.com/v1/observations/f2b469da-80ba-491b-a014-c931df0c4e10"},"peers":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-3dccf1e09941.png","evidence_url":"https://aidemos.com/evidence/cca7d6cc-f728-4cb2-90cc-acfaf4950c07"},{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/34d1c690-6d2f-40d4-862e-9abb5393a23d"},{"id":"2b999867-72e5-42be-9c1e-e117327ba4d0","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"failed","score":null,"score_total":null,"note":"The experience calculation undercounted the candidate badly, showing 2 years even though the report says the resume reflects about 6.5 years of experience.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/cvparserpro-p4-2years-8330234cdffb.png","evidence_url":"https://aidemos.com/evidence/2b999867-72e5-42be-9c1e-e117327ba4d0"},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-aa9cc0c96107.png","evidence_url":"https://aidemos.com/evidence/882018cc-18b9-49e9-8468-4edafdf5dcf8"},{"id":"1a1cbbe6-4c52-4ee3-a44b-e6725d653493","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The multi-column resume's name, email, phone, LinkedIn URL, location, and job title headline were extracted correctly.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-5135e1c903e9.png","evidence_url":"https://aidemos.com/evidence/1a1cbbe6-4c52-4ee3-a44b-e6725d653493"},{"id":"28351c6c-500d-4cec-ab69-5bd5685d7b86","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Leaves GPA blank and places 'Graduated: May 2019 | CGPA: 8.7/10' into Date.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/openresume-o5-gpa-priya-4a208843b703.png","evidence_url":"https://aidemos.com/evidence/28351c6c-500d-4cec-ab69-5bd5685d7b86"},{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skima-ai-04-truncated-input2-2aee29b8947f.png","evidence_url":"https://aidemos.com/evidence/d4316b90-c863-4d4b-a487-00a3eb8bd038"}],"other_criteria":[{"id":"5ac03134-220d-4956-8e36-d615fb2a780c","criterion":"multi-column-handling","criterion_name":"Multi-column handling","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"It can read a two-column/sidebar resume without crashing and pull content from both columns, but the parse is not perfectly layout-stable.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/5ac03134-220d-4956-8e36-d615fb2a780c"},{"id":"f44624ec-226f-4912-85ab-fb85254978ac","criterion":"noise-in-output","criterion_name":"Noise in output","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"It pollutes the skills list with project fragments such as 'parse 500', 'real-time sales forecasting dashboard', 'automation tool', 'aws lambda + s3', 'ci', and 'cd'.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/f44624ec-226f-4912-85ab-fb85254978ac"},{"id":"ee98cce8-ef44-4d9a-ae44-8b6b2503b5bf","criterion":"output-quality","criterion_name":"Output quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The two-column output is only moderate quality: core fields are present, but title truncation, noisy skills, and incomplete task extraction reduce usability.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/ee98cce8-ef44-4d9a-ae44-8b6b2503b5bf"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Tools for Parsing Resumes via API (2026)","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value."},{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency."},{"id":"2b999867-72e5-42be-9c1e-e117327ba4d0","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"failed","score":null,"score_total":null,"note":"The experience calculation undercounted the candidate badly, showing 2 years even though the report says the resume reflects about 6.5 years of experience."},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section."},{"id":"1a1cbbe6-4c52-4ee3-a44b-e6725d653493","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The multi-column resume's name, email, phone, LinkedIn URL, location, and job title headline were extracted correctly."},{"id":"28351c6c-500d-4cec-ab69-5bd5685d7b86","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Leaves GPA blank and places 'Graduated: May 2019 | CGPA: 8.7/10' into Date."},{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'"}]}