{"observation":{"id":"b4c264ab-7aee-45e0-a60b-583a4f461ad6","tool":"hireability","tool_name":"Hireability","criterion":"noise-in-output","criterion_name":"Noise in output","criterion_definition":"Does it add incorrect or hallucinated fields?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Incorrect or hallucinated fields mean the resume parser is not producing reliable structured data, which is central to the job. (3 of 3 judges)","scenario":"multi-column-sidebar-resume-priya-sharma","scenario_name":"Multi-column sidebar resume — Priya Sharma","group_tag":"resume-parsing","scenario_description":"A two-column sidebar resume for Priya Sharma, used to test whether parsers can preserve reading order and correctly extract content split across columns.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","role":"input"}],"stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"],"verdict":"failed","score":null,"score_total":null,"note":"The skills output contained blank level values and mixed in non-skill labels such as Engineering and Software as competencies.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/hireability-hireability-task2-competency-levels-blan-845c00e10224.png","role":"output","alt":null}],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","filename":"parseur-input2-priya-sharma-multicolumnresume-0e443ffc95c3.pdf","alt":"Multi-column sidebar resume — Priya Sharma","role":"input"}],"modality":"pdf","stresses":["multi-column layout handling","sidebar content extraction","reading-order robustness","projects extraction","languages and certifications extraction"]},"tool_page_slug":"hireability","tool_url":"https://aidemos.com/tools/hireability","permalink":"https://aidemos.com/evidence/b4c264ab-7aee-45e0-a60b-583a4f461ad6","api_url":"https://ai.aidemos.com/v1/observations/b4c264ab-7aee-45e0-a60b-583a4f461ad6"},"peers":[{"id":"feb0d081-16ca-4ce0-a99c-3f4d39622d58","tool":"affinda","tool_name":"Affinda","verdict":"failed","score":null,"score_total":null,"note":"The skill taxonomy can hallucinate unrelated terms; on this resume it injected American Welding Society Codes even though that text is not in the source.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-49ba3c23c23d.png","evidence_url":"https://aidemos.com/evidence/feb0d081-16ca-4ce0-a99c-3f4d39622d58"},{"id":"f44624ec-226f-4912-85ab-fb85254978ac","tool":"hrflow","tool_name":"HrFlow","verdict":"failed","score":null,"score_total":null,"note":"It pollutes the skills list with project fragments such as 'parse 500', 'real-time sales forecasting dashboard', 'automation tool', 'aws lambda + s3', 'ci', and 'cd'.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-cb57f7e2c714.png","evidence_url":"https://aidemos.com/evidence/f44624ec-226f-4912-85ab-fb85254978ac"}],"other_criteria":[{"id":"6d38aa3b-9f2d-4575-946a-88b808ba2548","criterion":"field-coverage","criterion_name":"Field coverage","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Six visible contact fields — GivenName, FamilyName, Email, Phone, LinkedIn, and Address — came back empty on the multi-column resume.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/6d38aa3b-9f2d-4575-946a-88b808ba2548"},{"id":"af1285e2-d752-4c9b-8399-5fb7131f4c19","criterion":"multi-column-handling","criterion_name":"Multi-column handling","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The two-column sidebar layout was misread as a job-order record, so the parser returned Title, PositionTitle, and MinimumEducationLevel instead of a candidate profile.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/af1285e2-d752-4c9b-8399-5fb7131f4c19"},{"id":"a242c7f2-c21c-4a1c-a38e-e24d698f957f","criterion":"output-quality","criterion_name":"Output quality","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Output quality collapsed on the two-column resume because the parser produced a job-order-style structure instead of a candidate resume structure.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a242c7f2-c21c-4a1c-a38e-e24d698f957f"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Tools for Parsing Resumes via API (2026)","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"feb0d081-16ca-4ce0-a99c-3f4d39622d58","tool":"affinda","tool_name":"Affinda","verdict":"failed","score":null,"score_total":null,"note":"The skill taxonomy can hallucinate unrelated terms; on this resume it injected American Welding Society Codes even though that text is not in the source."},{"id":"f44624ec-226f-4912-85ab-fb85254978ac","tool":"hrflow","tool_name":"HrFlow","verdict":"failed","score":null,"score_total":null,"note":"It pollutes the skills list with project fragments such as 'parse 500', 'real-time sales forecasting dashboard', 'automation tool', 'aws lambda + s3', 'ci', and 'cd'."}]}