{"observation":{"id":"372b36f6-3720-49f7-82fe-e7e711582fd1","tool":"hrflow","tool_name":"HrFlow","criterion":"accuracy","criterion_name":"Accuracy","criterion_definition":"Are extracted values correct and complete?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Correct and complete values are the essence of resume parsing, so this directly determines whether the tool succeeds. (3 of 3 judges)","scenario":"clean-single-column-resume-rugved-nichite","scenario_name":"Clean single-column resume — Rugved Nichite","group_tag":"resume-parsing","scenario_description":"A professionally structured single-column resume for Rugved Nichite, used as the baseline input for parser accuracy across standard resume fields.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input1-rugved-nichite-cleanresume-d776e5470f6f.pdf","role":"input"}],"stresses":["baseline field extraction","contact info accuracy","work experience parsing","education and CGPA extraction","skills and certifications extraction"],"verdict":"mixed","score":null,"score_total":null,"note":"On the clean resume, it still misses a listed task bullet ('Evaluated 10+ AI/ML APIs...') and does not return CGPA.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-image-5381d8e8011f.png","role":"input","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-hrflow-20output-201-9f17ceb5aef8.txt","role":"output","alt":null}],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input1-rugved-nichite-cleanresume-d776e5470f6f.pdf","filename":"parseur-input1-rugved-nichite-cleanresume-d776e5470f6f.pdf","alt":"Clean single-column resume — Rugved Nichite","role":"input"}],"modality":"pdf","stresses":["baseline field extraction","contact info accuracy","work experience parsing","education and CGPA extraction","skills and certifications extraction"]},"tool_page_slug":"hrflow","tool_url":"https://aidemos.com/tools/hrflow","permalink":"https://aidemos.com/evidence/372b36f6-3720-49f7-82fe-e7e711582fd1","api_url":"https://ai.aidemos.com/v1/observations/372b36f6-3720-49f7-82fe-e7e711582fd1"},"peers":[{"id":"1a6eb5ca-e960-4d56-9f4a-a6744370ed42","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It split one LinkedIn profile into two website fields and dropped the /in/ path segment, so the URL was not reconstructed as a single complete value.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-screenshot-202026-05-05-20120443-b5aaa4f8e2be.png","evidence_url":"https://aidemos.com/evidence/1a6eb5ca-e960-4d56-9f4a-a6744370ed42"},{"id":"e01042bc-4148-4eb2-8ba1-54f2655cf44a","tool":"airparser","tool_name":"Airparser","verdict":"mixed","score":null,"score_total":null,"note":"Silently truncates a compound job title, returning \"AI Research Analyst\" and dropping \"& Software Developer\".","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-63109c788cc0.png","evidence_url":"https://aidemos.com/evidence/e01042bc-4148-4eb2-8ba1-54f2655cf44a"},{"id":"d8917543-3f5a-4200-b53b-98b56593f872","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"failed","score":null,"score_total":null,"note":"The experience field was badly inflated: the profile header showed 11 years, while the report says the candidate actually had only about 2–3 years.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/cvparserpro-p1-11years-75db6e84a060.png","evidence_url":"https://aidemos.com/evidence/d8917543-3f5a-4200-b53b-98b56593f872"},{"id":"46baf4ea-c139-4aab-99a4-aac8c138b17a","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the CGPA as embedded text inside the education description string rather than extracting it as a standalone numeric field.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-screenshot-202026-05-05-20124028-cbdba62c2569.png","evidence_url":"https://aidemos.com/evidence/46baf4ea-c139-4aab-99a4-aac8c138b17a"},{"id":"fb7f5c99-a992-4126-8df5-f39c0b3bd205","tool":"hireability","tool_name":"Hireability","verdict":"failed","score":null,"score_total":null,"note":"Name accuracy failed: GivenName was split as 'Dev' and FamilyName as 'loper', producing FormattedName 'Dev loper' instead of the candidate's real name.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/hireability-hireability-task1-name-split-dev-loper-77c127014a1c.png","evidence_url":"https://aidemos.com/evidence/fb7f5c99-a992-4126-8df5-f39c0b3bd205"},{"id":"626615d5-990e-4d13-96e4-b93b64b2dbad","tool":"llamaparse","tool_name":"LlamaParse","verdict":"mixed","score":null,"score_total":null,"note":"The clean resume education GPA was captured, but as the string \"CGPA: 8.2 / 10\" instead of a clean normalized numeric value.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-7a1296182421.png","evidence_url":"https://aidemos.com/evidence/626615d5-990e-4d13-96e4-b93b64b2dbad"},{"id":"cd628ea5-009d-4af5-8342-2bc78d6b3768","tool":"openresume","tool_name":"OpenResume","verdict":"failed","score":null,"score_total":null,"note":"Misplaces GPA/CGPA into Date and leaves GPA blank, so academic data is routed to the wrong field.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/openresume-o3-gpa-in-date-field-50e69ddabe2d.png","evidence_url":"https://aidemos.com/evidence/cd628ea5-009d-4af5-8342-2bc78d6b3768"},{"id":"29c1ebce-80f1-41c2-9e9e-be6eaf915f4d","tool":"parseur","tool_name":"Parseur","verdict":"worked","score":null,"score_total":null,"note":"On the baseline resume, the identity/contact values were extracted correctly, including the candidate name, title, location, phone number, and LinkedIn URL.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/parseur-image-7-c5a350a2e9fe.png","evidence_url":"https://aidemos.com/evidence/29c1ebce-80f1-41c2-9e9e-be6eaf915f4d"},{"id":"b72526b7-24ba-4e63-aba9-f8bd88bc7f6e","tool":"skima-ai","tool_name":"Skima AI","verdict":"worked","score":null,"score_total":null,"note":"The core extracted values were correct on the clean resume, including Rugved Nichite, rugved.nchite@email.com, 9876500000, Vasind, the work histories, the education details, and the 2.9-year total experience figure.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skima-ai-01-input1-gpa-certs-missing-c59774f5e448.png","evidence_url":"https://aidemos.com/evidence/b72526b7-24ba-4e63-aba9-f8bd88bc7f6e"}],"other_criteria":[{"id":"16ecdece-b2b7-4e4b-a26e-f6271ad59376","criterion":"field-coverage","criterion_name":"Field coverage","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"On the clean resume, it extracted the core resume fields: name, email, phone, work experience, education, and skills.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/16ecdece-b2b7-4e4b-a26e-f6271ad59376"},{"id":"8421c170-76dc-4c5c-9767-77137b7087f7","criterion":"noise-in-output","criterion_name":"Noise in output","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"It injects non-skill fragments into the skills list, including 'ml apis', 'lambda', 's3', 'ml', and 'rest apis'.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/8421c170-76dc-4c5c-9767-77137b7087f7"},{"id":"cf59ea98-f74d-48cd-bf4f-23c3ef417532","criterion":"output-quality","criterion_name":"Output quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Overall output is usable, but the clean-resume parse still shows normalization and classification issues.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/cf59ea98-f74d-48cd-bf4f-23c3ef417532"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Tools for Parsing Resumes via API (2026)","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"1a6eb5ca-e960-4d56-9f4a-a6744370ed42","tool":"affinda","tool_name":"Affinda","verdict":"mixed","score":null,"score_total":null,"note":"It split one LinkedIn profile into two website fields and dropped the /in/ path segment, so the URL was not reconstructed as a single complete value."},{"id":"e01042bc-4148-4eb2-8ba1-54f2655cf44a","tool":"airparser","tool_name":"Airparser","verdict":"mixed","score":null,"score_total":null,"note":"Silently truncates a compound job title, returning \"AI Research Analyst\" and dropping \"& Software Developer\"."},{"id":"d8917543-3f5a-4200-b53b-98b56593f872","tool":"cvparserpro","tool_name":"CVParserPro","verdict":"failed","score":null,"score_total":null,"note":"The experience field was badly inflated: the profile header showed 11 years, while the report says the candidate actually had only about 2–3 years."},{"id":"46baf4ea-c139-4aab-99a4-aac8c138b17a","tool":"extracta-ai","tool_name":"Extracta.ai","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the CGPA as embedded text inside the education description string rather than extracting it as a standalone numeric field."},{"id":"fb7f5c99-a992-4126-8df5-f39c0b3bd205","tool":"hireability","tool_name":"Hireability","verdict":"failed","score":null,"score_total":null,"note":"Name accuracy failed: GivenName was split as 'Dev' and FamilyName as 'loper', producing FormattedName 'Dev loper' instead of the candidate's real name."},{"id":"626615d5-990e-4d13-96e4-b93b64b2dbad","tool":"llamaparse","tool_name":"LlamaParse","verdict":"mixed","score":null,"score_total":null,"note":"The clean resume education GPA was captured, but as the string \"CGPA: 8.2 / 10\" instead of a clean normalized numeric value."},{"id":"cd628ea5-009d-4af5-8342-2bc78d6b3768","tool":"openresume","tool_name":"OpenResume","verdict":"failed","score":null,"score_total":null,"note":"Misplaces GPA/CGPA into Date and leaves GPA blank, so academic data is routed to the wrong field."},{"id":"29c1ebce-80f1-41c2-9e9e-be6eaf915f4d","tool":"parseur","tool_name":"Parseur","verdict":"worked","score":null,"score_total":null,"note":"On the baseline resume, the identity/contact values were extracted correctly, including the candidate name, title, location, phone number, and LinkedIn URL."},{"id":"b72526b7-24ba-4e63-aba9-f8bd88bc7f6e","tool":"skima-ai","tool_name":"Skima AI","verdict":"worked","score":null,"score_total":null,"note":"The core extracted values were correct on the clean resume, including Rugved Nichite, rugved.nchite@email.com, 9876500000, Vasind, the work histories, the education details, and the 2.9-year total experience figure."}]}