{"observation":{"id":"34d1c690-6d2f-40d4-862e-9abb5393a23d","tool":"airparser","tool_name":"Airparser","criterion":"accuracy","criterion_name":"Accuracy","criterion_definition":"Are extracted values correct and complete?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Correct and complete values are the essence of resume parsing, so this directly determines whether the tool succeeds. (3 of 3 judges)","scenario":"multi-column-sidebar-resume-priya-sharma","scenario_name":"Multi-column sidebar resume — Priya Sharma","group_tag":"resume-parsing","scenario_description":"A two-column sidebar resume for Priya Sharma, used to test whether parsers can preserve reading order and correctly extract content split across columns.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","role":"input"}],"stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"],"verdict":"worked","score":null,"score_total":null,"note":"Keeps the extracted values correct and complete on the two-column resume, including contact details, CGPA 8.7/10, project metrics, and language proficiency.","evidence_state":"observed","source":null,"artifacts":[],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-only","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","filename":"parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","alt":"Multi-column sidebar resume — Priya Sharma","role":"input"}],"modality":"pdf","stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"]},"tool_page_slug":"airparser","tool_url":"https://aidemos.com/tools/airparser","permalink":"https://aidemos.com/evidence/34d1c690-6d2f-40d4-862e-9abb5393a23d","api_url":"https://ai.aidemos.com/v1/observations/34d1c690-6d2f-40d4-862e-9abb5393a23d"},"peers":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-3dccf1e09941.png","evidence_url":"https://aidemos.com/evidence/cca7d6cc-f728-4cb2-90cc-acfaf4950c07"},{"id":"38e7e96c-ca4c-49f1-a707-df05917e3329","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"mixed","score":null,"score_total":null,"note":"The certification entries were returned without issuing organizations, so the parser dropped issuer data for both certificates.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/cvparserpro-p6-cert-orgs-missing-a86ef2b92516.png","evidence_url":"https://aidemos.com/evidence/38e7e96c-ca4c-49f1-a707-df05917e3329"},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-aa9cc0c96107.png","evidence_url":"https://aidemos.com/evidence/882018cc-18b9-49e9-8468-4edafdf5dcf8"},{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-dfe47b81f568.png","evidence_url":"https://aidemos.com/evidence/f2b469da-80ba-491b-a014-c931df0c4e10"},{"id":"a90c31b5-b17f-409b-9b4c-ec89a653ac9b","tool":"llamaparse","tool_name":"LlamaParse","verdict":"mixed","score":null,"score_total":null,"note":"Certifications were extracted, but the issuer field was dropped entirely on the multi-column resume, so only name and year remained.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-86b8b2ac1a91.png","evidence_url":"https://aidemos.com/evidence/a90c31b5-b17f-409b-9b4c-ec89a653ac9b"},{"id":"28351c6c-500d-4cec-ab69-5bd5685d7b86","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Leaves GPA blank and places 'Graduated: May 2019 | CGPA: 8.7/10' into Date.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/openresume-o5-gpa-priya-4a208843b703.png","evidence_url":"https://aidemos.com/evidence/28351c6c-500d-4cec-ab69-5bd5685d7b86"},{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skima-ai-04-truncated-input2-2aee29b8947f.png","evidence_url":"https://aidemos.com/evidence/d4316b90-c863-4d4b-a487-00a3eb8bd038"}],"other_criteria":[{"id":"8ea09c29-07ce-4fad-b081-4789ec63dd29","criterion":"field-coverage","criterion_name":"Field coverage","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Covers the six core fields from a two-column resume, including split-header contact info, work experience, education, and skills.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/8ea09c29-07ce-4fad-b081-4789ec63dd29"},{"id":"fad9a0e1-8b19-49fc-ac44-675d2b390710","criterion":"multi-column-handling","criterion_name":"Multi-column handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Correctly parses the two-column layout, extracting left-column experience and the right-sidebar sections without losing them.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/fad9a0e1-8b19-49fc-ac44-675d2b390710"},{"id":"579f59ad-e495-4503-a0bb-204f9e734432","criterion":"output-quality","criterion_name":"Output quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Produces structured JSON, but the skills section loses its original category grouping and comes back as a flat list.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/579f59ad-e495-4503-a0bb-204f9e734432"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Resume Parser APIs for Structured JSON Output","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"cca7d6cc-f728-4cb2-90cc-acfaf4950c07","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It again left the CGPA numeric score empty on the multi-column resume, capturing only the CGPA unit and missing the visible 8.7 value."},{"id":"38e7e96c-ca4c-49f1-a707-df05917e3329","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"mixed","score":null,"score_total":null,"note":"The certification entries were returned without issuing organizations, so the parser dropped issuer data for both certificates."},{"id":"882018cc-18b9-49e9-8468-4edafdf5dcf8","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the dedicated spoken-languages list as English, Hindi, and Marathi from the right-side LANGUAGES section."},{"id":"f2b469da-80ba-491b-a014-c931df0c4e10","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"On the two-column resume, it truncates the job title, dropping the '— ML' suffix from 'Software Engineer — ML'."},{"id":"a90c31b5-b17f-409b-9b4c-ec89a653ac9b","tool":"llamaparse","tool_name":"LlamaParse","verdict":"mixed","score":null,"score_total":null,"note":"Certifications were extracted, but the issuer field was dropped entirely on the multi-column resume, so only name and year remained."},{"id":"28351c6c-500d-4cec-ab69-5bd5685d7b86","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"Leaves GPA blank and places 'Graduated: May 2019 | CGPA: 8.7/10' into Date."},{"id":"d4316b90-c863-4d4b-a487-00a3eb8bd038","tool":"skima-ai","tool_name":"Skima AI","verdict":"failed","score":null,"score_total":null,"note":"The parser truncated responsibility text mid-sentence on the multi-column resume, cutting off the quantified detail after 'cutting costs by.'"}]}