{"observation":{"id":"6bcb2b64-15e6-48ae-a573-c64ce593b810","tool":"extracta-ai","tool_name":"Extracta.ai","criterion":"output-quality","criterion_name":"Output quality","criterion_definition":"Is the parsed result clean, complete, and usable overall?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"The whole point is usable structured extraction; clean, complete, usable output is the core measure of success. (3 of 3 judges)","scenario":"clean-single-column-resume-rugved-nichite","scenario_name":"Clean single-column resume — Rugved Nichite","group_tag":"resume-parsing","scenario_description":"A professionally structured single-column resume for Rugved Nichite, used as the baseline input for parser accuracy across standard resume fields.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/parseur-input1-rugved-nichite-cleanresume-d776e5470f6f.pdf","role":"input"}],"stresses":["baseline field extraction","contact info accuracy","work experience parsing","education and CGPA extraction","skills and certifications extraction"],"verdict":"worked","score":null,"score_total":null,"note":"Returns a clean, minimal JSON payload with the core resume sections extracted and no extra metadata noise.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/research-media-screenshot-202026-05-05-20124028-cbdba62c2569.png","role":"input","alt":"Research media screenshot 202026 05 05 20124028.png"},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-extracta-ai-20output-201-a01c085fbe66.txt","role":"output","alt":null}],"run_id":"cbbef4db-964c-49fa-a57f-a2977822bdfc","study_title":"Parse resumes into structured data using an API","study_kind":"generation","research_task":"86b9jm30n","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/parseur-input1-rugved-nichite-cleanresume-d776e5470f6f.pdf","filename":"parseur-input1-rugved-nichite-cleanresume-d776e5470f6f.pdf","alt":"Clean single-column resume — Rugved Nichite","role":"input"}],"modality":"pdf","stresses":["baseline field extraction","contact info accuracy","work experience parsing","education and CGPA extraction","skills and certifications extraction"]},"tool_page_slug":"extracta-labs","tool_url":"https://aidemos.com/tools/extracta-labs","permalink":"https://aidemos.com/evidence/6bcb2b64-15e6-48ae-a573-c64ce593b810","api_url":"https://ai.aidemos.com/v1/observations/6bcb2b64-15e6-48ae-a573-c64ce593b810"},"peers":[{"id":"92e8644f-bb57-441f-9a69-f288f51acec1","tool":"airparser","tool_name":"Airparser","verdict":"mixed","score":null,"score_total":null,"note":"Produces readable, structured JSON, but the overall parse quality is reduced by a wrong email address and a truncated job title.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-5652d1899ce8.png","evidence_url":"https://aidemos.com/evidence/92e8644f-bb57-441f-9a69-f288f51acec1"},{"id":"b7dcbf54-10e5-4d56-8f9c-b4e8a833c148","tool":"hireability","tool_name":"Hireability","verdict":"mixed","score":null,"score_total":null,"note":"The clean-resume output was broadly usable, but overall quality was weakened by a split name and flattened skill structure, so the result was not fully clean.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/hireability-hireability-task1-name-split-dev-loper-77c127014a1c.png","evidence_url":"https://aidemos.com/evidence/b7dcbf54-10e5-4d56-8f9c-b4e8a833c148"},{"id":"cf59ea98-f74d-48cd-bf4f-23c3ef417532","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"Overall output is usable, but the clean-resume parse still shows normalization and classification issues.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-5381d8e8011f.png","evidence_url":"https://aidemos.com/evidence/cf59ea98-f74d-48cd-bf4f-23c3ef417532"},{"id":"d74cf6a8-95be-4016-8990-a79f91b0c1dd","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The clean-resume output was structurally rich: skills were grouped into categorized arrays, certifications were separate objects with name/issuer/year, and work responsibilities were split into individual array items.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-image-7c7c72d0b559.png","evidence_url":"https://aidemos.com/evidence/d74cf6a8-95be-4016-8990-a79f91b0c1dd"},{"id":"cba2cdbf-ba8f-4fb4-a403-992dceb6c15c","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"On a clean single-column resume, the output is mostly usable but still partial because the Name field is blank and Phone/Location are missing.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/openresume-o1-name-empty-a76b7c79fa7e.png","evidence_url":"https://aidemos.com/evidence/cba2cdbf-ba8f-4fb4-a403-992dceb6c15c"},{"id":"9b3c2b38-2ef7-48c3-81e8-7b13990da97b","tool":"parseur","tool_name":"Parseur","verdict":"mixed","score":null,"score_total":null,"note":"CGPA was embedded inside the education string rather than extracted as a dedicated field.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/parseur-pa2-cgpa-embedded-0ced843edb15.png","evidence_url":"https://aidemos.com/evidence/9b3c2b38-2ef7-48c3-81e8-7b13990da97b"},{"id":"466848f3-01a1-45a4-9d9a-7392fad7c254","tool":"skima-ai","tool_name":"Skima AI","verdict":"mixed","score":null,"score_total":null,"note":"The clean-resume output was moderately usable: the basics were correct, but certifications and GPA were missing and the responsibilities/skills sections still showed formatting artifacts.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skima-ai-01-input1-gpa-certs-missing-c59774f5e448.png","evidence_url":"https://aidemos.com/evidence/466848f3-01a1-45a4-9d9a-7392fad7c254"}],"other_criteria":[{"id":"af7f942c-0377-4544-847c-c687a02bf8ac","criterion":"accuracy","criterion_name":"Accuracy","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Correctly extracts the core personal and work-history values from the clean resume, including both jobs, the education entry, two certifications, and the full 15-skill list.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/af7f942c-0377-4544-847c-c687a02bf8ac"},{"id":"46baf4ea-c139-4aab-99a4-aac8c138b17a","criterion":"accuracy","criterion_name":"Accuracy","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the CGPA as embedded text inside the education description string rather than extracting it as a standalone numeric field.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/46baf4ea-c139-4aab-99a4-aac8c138b17a"},{"id":"635396c5-3724-439f-8110-ca50c8ea7318","criterion":"field-coverage","criterion_name":"Field coverage","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Covers the standard resume fields needed for the baseline test: name, email, phone, experience, education, and skills are all present.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/635396c5-3724-439f-8110-ca50c8ea7318"},{"id":"f89caf00-224f-4aa6-8199-1b2b68ea6d2f","criterion":"noise-in-output","criterion_name":"Noise in output","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Puts four programming languages — Python, JavaScript, SQL, and Bash — into the Languages field even though the resume does not contain a spoken-languages section.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/f89caf00-224f-4aa6-8199-1b2b68ea6d2f"}],"appears_in":[{"page_type":"ranking","slug":"resume-parsing-api","title":"Best AI Tools for Parsing Resumes via API (2026)","url":"https://aidemos.com/best/resume-parsing-api","binding":"run"}],"same_scenario":[{"id":"92e8644f-bb57-441f-9a69-f288f51acec1","tool":"airparser","tool_name":"Airparser","verdict":"mixed","score":null,"score_total":null,"note":"Produces readable, structured JSON, but the overall parse quality is reduced by a wrong email address and a truncated job title."},{"id":"b7dcbf54-10e5-4d56-8f9c-b4e8a833c148","tool":"hireability","tool_name":"Hireability","verdict":"mixed","score":null,"score_total":null,"note":"The clean-resume output was broadly usable, but overall quality was weakened by a split name and flattened skill structure, so the result was not fully clean."},{"id":"cf59ea98-f74d-48cd-bf4f-23c3ef417532","tool":"hrflow","tool_name":"HrFlow","verdict":"mixed","score":null,"score_total":null,"note":"Overall output is usable, but the clean-resume parse still shows normalization and classification issues."},{"id":"d74cf6a8-95be-4016-8990-a79f91b0c1dd","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"The clean-resume output was structurally rich: skills were grouped into categorized arrays, certifications were separate objects with name/issuer/year, and work responsibilities were split into individual array items."},{"id":"cba2cdbf-ba8f-4fb4-a403-992dceb6c15c","tool":"openresume","tool_name":"OpenResume","verdict":"mixed","score":null,"score_total":null,"note":"On a clean single-column resume, the output is mostly usable but still partial because the Name field is blank and Phone/Location are missing."},{"id":"9b3c2b38-2ef7-48c3-81e8-7b13990da97b","tool":"parseur","tool_name":"Parseur","verdict":"mixed","score":null,"score_total":null,"note":"CGPA was embedded inside the education string rather than extracted as a dedicated field."},{"id":"466848f3-01a1-45a4-9d9a-7392fad7c254","tool":"skima-ai","tool_name":"Skima AI","verdict":"mixed","score":null,"score_total":null,"note":"The clean-resume output was moderately usable: the basics were correct, but certifications and GPA were missing and the responsibilities/skills sections still showed formatting artifacts."}]}