{"observation":{"id":"137693ad-48f6-4821-a813-5520e70b5585","tool":"landing-ai","tool_name":"Landing AI","criterion":"visual-content-retention","criterion_name":"Visual Content Retention","criterion_definition":"Retains charts, figures, diagrams, and images in the output and places them in the correct reading position.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"For complex PDFs, figures, charts, and images are part of the document content, so preserving them in the right place is part of the core job. (3 of 3 judges)","scenario":"scanned-research-paper","scenario_name":"Scanned Research Paper","group_tag":"scanned-research-paper","scenario_description":"An image-only scanned research paper used to stress OCR and layout recovery in a multi-column academic document with figures, charts, tables, captions, and references.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/convert-a-complex-pdf-into-clean-markdow-scanned-research-pdf-7b86de49784d.pdf","role":"input","filename":"Scanned Research PDF.pdf"}],"stresses":["OCR on scanned pages","Multi-column reading order","Figure and chart handling","Table reconstruction from scans","Caption association","Reference extraction","Overall document structure retention"],"verdict":"failed","score":null,"score_total":null,"note":"Converts a scanned bar chart into a textual transcription of legend items and approximate values instead of retaining the chart visually in the output.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/de1454c783be40d6ae9c9be1b56215f5.png?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/867dfaa065624656b681ae821978c7c1.png?v=1","role":"output","alt":null}],"run_id":"6e3160de-fe46-4b45-b071-72560b5c5d0e","study_title":"Convert a Complex PDF into Clean Markdown with an API","study_kind":"generation","research_task":"86b9h7t37","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/convert-a-complex-pdf-into-clean-markdow-scanned-research-pdf-7b86de49784d.pdf","filename":"Scanned Research PDF.pdf","alt":"Scanned Research Paper","role":"input"}],"modality":"pdf","stresses":["OCR on scanned pages","Multi-column reading order","Figure and chart handling","Table reconstruction from scans","Caption association","Reference extraction","Overall document structure retention"]},"tool_page_slug":"landing-ai","tool_url":"https://aidemos.com/tools/landing-ai","permalink":"https://aidemos.com/evidence/137693ad-48f6-4821-a813-5520e70b5585","api_url":"https://ai.aidemos.com/v1/observations/137693ad-48f6-4821-a813-5520e70b5585"},"peers":[{"id":"aaf02083-a041-4bdf-b6af-90778cdde03b","tool":"adobe-api","tool_name":"Adobe API","verdict":"worked","score":null,"score_total":null,"note":"Keeps chart artwork embedded in the extracted page, placing the residual basal-area figure in situ beneath the extracted table text.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a31a06257031453a906fcd8c3e2bbb51.png?v=1","evidence_url":"https://aidemos.com/evidence/aaf02083-a041-4bdf-b6af-90778cdde03b"},{"id":"1074ca2a-2a45-4de6-a0fb-e861d4262e74","tool":"extend-ai","tool_name":"Extend AI","verdict":"mixed","score":null,"score_total":null,"note":"Extracts chart values into a captioned figure block, but the report says the mortality chart's trend visualization is not fully retained.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/de1454c783be40d6ae9c9be1b56215f5.png?v=1","evidence_url":"https://aidemos.com/evidence/1074ca2a-2a45-4de6-a0fb-e861d4262e74"},{"id":"aef48456-2bfd-45ec-8fb3-91f61fa0605a","tool":"llamaparse","tool_name":"LlamaParse","verdict":"mixed","score":null,"score_total":null,"note":"Converts a bar chart into a structured table, preserving the legend/value mapping but not keeping the chart as a visual chart.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/16cfd0f3cdd443728306c6efd579553d.png?v=1","evidence_url":"https://aidemos.com/evidence/aef48456-2bfd-45ec-8fb3-91f61fa0605a"},{"id":"0f3a42b1-0d18-4374-bbeb-cd6776d7b79e","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"Charts are exposed through both page-wise markdown files and the extracted visual assets, keeping the visual content linked to its original document location.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/45e3533a31c246b29e0ec6aaa98438e4.pdf?v=1","evidence_url":"https://aidemos.com/evidence/0f3a42b1-0d18-4374-bbeb-cd6776d7b79e"},{"id":"474d7192-6964-4d73-9726-1ca2efcb6edc","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"struggled","score":null,"score_total":null,"note":"Extracts the Figure 3 chart's values, but the chart structure and layout are not preserved, so the visualization is flattened into text-like output.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/1aca5ae754c14b309d12845ef3f598c5.png?v=1","evidence_url":"https://aidemos.com/evidence/474d7192-6964-4d73-9726-1ca2efcb6edc"},{"id":"ab812bbc-7ab3-4b0c-82e1-e142cb5375fe","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"Segments a shield logo out of a single full-page raster scan and also retains Figure 1 as an image with an accurate synthesized caption; the returned logo crop is a tight 77x81px cut with legible shield text.","artifact_count":5,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/c644ea8b706847c99c670095d6eacb60.png?v=1","evidence_url":"https://aidemos.com/evidence/ab812bbc-7ab3-4b0c-82e1-e142cb5375fe"}],"other_criteria":[{"id":"4d96cef6-8e58-4798-b86c-1b626c8d3ae2","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a dense two-column section with its hierarchy intact, keeping the section heading attached to the correct body text across the columns.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/4d96cef6-8e58-4798-b86c-1b626c8d3ae2"},{"id":"62508de5-ad84-488e-9a0e-e27c57f1f43f","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Misinterprets the opening page's structure, breaking the relationship between the title and surrounding content on the scanned paper.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/62508de5-ad84-488e-9a0e-e27c57f1f43f"},{"id":"6c6cd8b2-a68f-4199-8ad7-e9765bf012f1","criterion":"table-preservation","criterion_name":"Table Preservation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Preserves a complex diameter-class table with before-cut, trees-cut-per-acre, and after-cut relationships across the treatment rows and check area.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/6c6cd8b2-a68f-4199-8ad7-e9765bf012f1"},{"id":"0bfcd599-6c54-476e-94c8-d8773b3595ca","criterion":"table-preservation","criterion_name":"Table Preservation","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Partially reflects the text that sits between table columns, but the intervening content still disrupts the table structure in the parsed output.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/0bfcd599-6c54-476e-94c8-d8773b3595ca"},{"id":"d162b0b4-78dd-4ace-81af-d47f25041f26","criterion":"text-ocr-completeness","criterion_name":"Text & OCR Completeness","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"OCRs most of the scanned cover-page text, including the agency header, report number/date, title, authors, abstract, and keywords, but inserts noisy tokens such as '186153' and 'USA/-' into the title line.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/d162b0b4-78dd-4ace-81af-d47f25041f26"}],"appears_in":[{"page_type":"ranking","slug":"pdf-to-markdown-apis","title":"Best AI Tools to Convert Complex PDFs into Clean Markdown with an API","url":"https://aidemos.com/best/pdf-to-markdown-apis","binding":"run"}],"same_scenario":[{"id":"aaf02083-a041-4bdf-b6af-90778cdde03b","tool":"adobe-api","tool_name":"Adobe API","verdict":"worked","score":null,"score_total":null,"note":"Keeps chart artwork embedded in the extracted page, placing the residual basal-area figure in situ beneath the extracted table text."},{"id":"1074ca2a-2a45-4de6-a0fb-e861d4262e74","tool":"extend-ai","tool_name":"Extend AI","verdict":"mixed","score":null,"score_total":null,"note":"Extracts chart values into a captioned figure block, but the report says the mortality chart's trend visualization is not fully retained."},{"id":"aef48456-2bfd-45ec-8fb3-91f61fa0605a","tool":"llamaparse","tool_name":"LlamaParse","verdict":"mixed","score":null,"score_total":null,"note":"Converts a bar chart into a structured table, preserving the legend/value mapping but not keeping the chart as a visual chart."},{"id":"0f3a42b1-0d18-4374-bbeb-cd6776d7b79e","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"Charts are exposed through both page-wise markdown files and the extracted visual assets, keeping the visual content linked to its original document location."},{"id":"474d7192-6964-4d73-9726-1ca2efcb6edc","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"struggled","score":null,"score_total":null,"note":"Extracts the Figure 3 chart's values, but the chart structure and layout are not preserved, so the visualization is flattened into text-like output."},{"id":"ab812bbc-7ab3-4b0c-82e1-e142cb5375fe","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"Segments a shield logo out of a single full-page raster scan and also retains Figure 1 as an image with an accurate synthesized caption; the returned logo crop is a tight 77x81px cut with legible shield text."}]}