{"observation":{"id":"967e61c9-53cd-47b4-b6a0-a5ef8eec542a","tool":"landing-ai","tool_name":"Landing AI","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","criterion_definition":"Maintains headings, sections, column order, document hierarchy, and overall flow.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Clean Markdown requires the original reading order, headings, sections, and hierarchy to be maintained correctly. (3 of 3 judges)","scenario":"hybrid-earnings-report","scenario_name":"Hybrid Earnings Report","group_tag":"hybrid-earnings-report","scenario_description":"A long, real-world hybrid annual report used to benchmark end-to-end PDF-to-markdown conversion. It combines native text, financial tables, charts/graphics, and scanned signature/stamp regions, stressing preservation of document structure, reading order, and embedded visual content across a multi-section report.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/f63a44b441704753b65d1b89dc9b4bbb.pdf?v=1","role":"input","filename":"Target-2015-Annual-Report.pdf"}],"stresses":["Native digital text extraction","Complex financial table preservation","Chart and graphic retention","Image-based signatures and stamps","Reading order across a long multi-section report","Markdown quality and consistency"],"verdict":"worked","score":null,"score_total":null,"note":"Preserves section flow and heading-to-body relationships in a scanned report section, keeping the '19. Commitments and Contingencies' heading and the 'Data Breach' subsection attached to the following paragraphs.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/a790fa57065c48c1a0ff2ae86a137b30.png?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/2e5a80fa66d7411b857ee3eca57858bc.png?v=1","role":"output","alt":null}],"run_id":"6e3160de-fe46-4b45-b071-72560b5c5d0e","study_title":"Convert a Complex PDF into Clean Markdown with an API","study_kind":"generation","research_task":"86b9h7t37","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/f63a44b441704753b65d1b89dc9b4bbb.pdf?v=1","filename":"Target-2015-Annual-Report.pdf","alt":"Hybrid Earnings Report","role":"input"}],"modality":"pdf","stresses":["Native digital text extraction","Complex financial table preservation","Chart and graphic retention","Image-based signatures and stamps","Reading order across a long multi-section report","Markdown quality and consistency"]},"tool_page_slug":"landing-ai","tool_url":"https://aidemos.com/tools/landing-ai","permalink":"https://aidemos.com/evidence/967e61c9-53cd-47b4-b6a0-a5ef8eec542a","api_url":"https://ai.aidemos.com/v1/observations/967e61c9-53cd-47b4-b6a0-a5ef8eec542a"},"peers":[{"id":"b69aa8f8-8162-47d0-9487-6b903f8ffe84","tool":"extend-ai","tool_name":"Extend AI","verdict":"worked","score":null,"score_total":null,"note":"Maintains report hierarchy and reading flow in an 84-page annual report, keeping section text, bullets, and business narrative aligned instead of flattening them.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/873484510a8043f4aab79218961e3792.png?v=1","evidence_url":"https://aidemos.com/evidence/b69aa8f8-8162-47d0-9487-6b903f8ffe84"},{"id":"b215b483-82ab-4eea-b284-224d015ee6d9","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Keeps the report's heading-and-paragraph sequence intact instead of flattening the page into disconnected text blocks.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ffa3c24e43fe4b0e94575a7850ae516c.png?v=1","evidence_url":"https://aidemos.com/evidence/b215b483-82ab-4eea-b284-224d015ee6d9"},{"id":"d89c69f3-025a-4dd1-9d85-6524482d5b29","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"The parser preserves document hierarchy across most sections of the long report, keeping headings and supporting text structurally aligned through the majority of the output.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/5146feec22e24b90973adb1b7c04f394.png?v=1","evidence_url":"https://aidemos.com/evidence/d89c69f3-025a-4dd1-9d85-6524482d5b29"},{"id":"06972bd3-507c-482f-b7a4-54f4d73c730e","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"worked","score":null,"score_total":null,"note":"Preserves the section hierarchy and bullet-point reading order on the sample page, keeping the 'A Growth Story Again' heading tied to its paragraph and 4 bullets in sequence.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/873484510a8043f4aab79218961e3792.png?v=1","evidence_url":"https://aidemos.com/evidence/06972bd3-507c-482f-b7a4-54f4d73c730e"},{"id":"77c69713-eb97-47e0-8b45-b4d8c8902bc2","tool":"reducto","tool_name":"Reducto","verdict":"struggled","score":null,"score_total":null,"note":"Drops heading structure on most of the filing: the FORM 10-K opening area receives no # or ## markup, and the report says 80 of 84 pages stay as plain paragraphs rather than navigable section headings.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/5f3d435917c9449a8bc46b8b7efad760.png?v=1","evidence_url":"https://aidemos.com/evidence/77c69713-eb97-47e0-8b45-b4d8c8902bc2"},{"id":"78afa8fc-60fb-4141-ac60-95e3c6e00369","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Preserves heading order and section relationships in an 84-page hybrid annual report, keeping the narrative, bullets, and figure placement aligned with the source flow.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/873484510a8043f4aab79218961e3792.png?v=1","evidence_url":"https://aidemos.com/evidence/78afa8fc-60fb-4141-ac60-95e3c6e00369"},{"id":"07e93c54-d160-40c0-b3ba-519704752930","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"failed","score":null,"score_total":null,"note":"Breaks the two-column reading order on the annual-report page, so headings and body text no longer follow the source navigation cleanly.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/adb683c35665414898107043d7650bc0.png?v=1","evidence_url":"https://aidemos.com/evidence/07e93c54-d160-40c0-b3ba-519704752930"}],"other_criteria":[{"id":"51f08c65-3c19-4c23-8666-87b5d8a58831","criterion":"advanced-features","criterion_name":"Advanced Features","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"Emits semantic attestation blocks for handwritten-signature regions and a blurry signature stamp, distinguishing the signer/company name and the signature legibility instead of leaving those regions unannotated.","artifact_count":5,"evidence_url":"https://aidemos.com/evidence/51f08c65-3c19-4c23-8666-87b5d8a58831"},{"id":"cf877f70-2748-444d-a7fa-54c75d902c97","criterion":"table-preservation","criterion_name":"Table Preservation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a five-year financial results table with the 2015–2011 columns and aligned row/value relationships intact in markdown-style rows.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/cf877f70-2748-444d-a7fa-54c75d902c97"},{"id":"97bf4c42-ab87-4b0a-913c-2823e833dd10","criterion":"visual-content-retention","criterion_name":"Visual Content Retention","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Replaces a waterfall chart with text, preserving the SG&A rate values and year-to-year change labels but not the chart as a visual asset in the output.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/97bf4c42-ab87-4b0a-913c-2823e833dd10"}],"appears_in":[{"page_type":"ranking","slug":"pdf-to-markdown-apis","title":"Best AI Tools to Convert Complex PDFs into Clean Markdown with an API","url":"https://aidemos.com/best/pdf-to-markdown-apis","binding":"run"}],"same_scenario":[{"id":"b69aa8f8-8162-47d0-9487-6b903f8ffe84","tool":"extend-ai","tool_name":"Extend AI","verdict":"worked","score":null,"score_total":null,"note":"Maintains report hierarchy and reading flow in an 84-page annual report, keeping section text, bullets, and business narrative aligned instead of flattening them."},{"id":"b215b483-82ab-4eea-b284-224d015ee6d9","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Keeps the report's heading-and-paragraph sequence intact instead of flattening the page into disconnected text blocks."},{"id":"d89c69f3-025a-4dd1-9d85-6524482d5b29","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"The parser preserves document hierarchy across most sections of the long report, keeping headings and supporting text structurally aligned through the majority of the output."},{"id":"06972bd3-507c-482f-b7a4-54f4d73c730e","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"worked","score":null,"score_total":null,"note":"Preserves the section hierarchy and bullet-point reading order on the sample page, keeping the 'A Growth Story Again' heading tied to its paragraph and 4 bullets in sequence."},{"id":"77c69713-eb97-47e0-8b45-b4d8c8902bc2","tool":"reducto","tool_name":"Reducto","verdict":"struggled","score":null,"score_total":null,"note":"Drops heading structure on most of the filing: the FORM 10-K opening area receives no # or ## markup, and the report says 80 of 84 pages stay as plain paragraphs rather than navigable section headings."},{"id":"78afa8fc-60fb-4141-ac60-95e3c6e00369","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Preserves heading order and section relationships in an 84-page hybrid annual report, keeping the narrative, bullets, and figure placement aligned with the source flow."},{"id":"07e93c54-d160-40c0-b3ba-519704752930","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"failed","score":null,"score_total":null,"note":"Breaks the two-column reading order on the annual-report page, so headings and body text no longer follow the source navigation cleanly."}]}