{"observation":{"id":"51f08c65-3c19-4c23-8666-87b5d8a58831","tool":"landing-ai","tool_name":"Landing AI","criterion":"advanced-features","criterion_name":"Advanced Features","criterion_definition":"Provides separate table/chart extraction and flags low-confidence OCR or ambiguous regions.","criterion_evidence_type":"transformation","criterion_rank_role":"context","criterion_rank_role_reason":"Separate extraction modes and OCR confidence flags are useful workflow features, but they do not by themselves determine whether the Markdown conversion is good. (3 of 3 judges)","scenario":"hybrid-earnings-report","scenario_name":"Hybrid Earnings Report","group_tag":"hybrid-earnings-report","scenario_description":"A long, real-world hybrid annual report used to benchmark end-to-end PDF-to-markdown conversion. It combines native text, financial tables, charts/graphics, and scanned signature/stamp regions, stressing preservation of document structure, reading order, and embedded visual content across a multi-section report.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/f63a44b441704753b65d1b89dc9b4bbb.pdf?v=1","role":"input","filename":"Target-2015-Annual-Report.pdf"}],"stresses":["Native digital text extraction","Complex financial table preservation","Chart and graphic retention","Image-based signatures and stamps","Reading order across a long multi-section report","Markdown quality and consistency"],"verdict":"worked","score":null,"score_total":null,"note":"Emits semantic attestation blocks for handwritten-signature regions and a blurry signature stamp, distinguishing the signer/company name and the signature legibility instead of leaving those regions unannotated.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/1f45fe222ffc4719ad527014bd6fabbf.png?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/d4e0268f33354cd8a2a3c33e660f6924.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/6cbf1e9cd25a47e483a0144f1dcc4b61.png?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/f025c18bf50743d58bf5d6411525e8ab.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/cf7bff9ddf1b4ab68c0ba6a58382de37.png?v=1","role":"output","alt":null}],"run_id":"6e3160de-fe46-4b45-b071-72560b5c5d0e","study_title":"Convert a Complex PDF into Clean Markdown with an API","study_kind":"generation","research_task":"86b9h7t37","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/f63a44b441704753b65d1b89dc9b4bbb.pdf?v=1","filename":"Target-2015-Annual-Report.pdf","alt":"Hybrid Earnings Report","role":"input"}],"modality":"pdf","stresses":["Native digital text extraction","Complex financial table preservation","Chart and graphic retention","Image-based signatures and stamps","Reading order across a long multi-section report","Markdown quality and consistency"]},"tool_page_slug":"landing-ai","tool_url":"https://aidemos.com/tools/landing-ai","permalink":"https://aidemos.com/evidence/51f08c65-3c19-4c23-8666-87b5d8a58831","api_url":"https://ai.aidemos.com/v1/observations/51f08c65-3c19-4c23-8666-87b5d8a58831"},"peers":[{"id":"5b164bff-8ffe-46e2-b493-883b4ed9fed4","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"The separate schema-driven extract.run endpoint cleanly recovers both a financial table and a donut chart: all requested table rows and all five donut percentages come back exactly.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/27079c195497426b998691e2f7749eea.png?v=1","evidence_url":"https://aidemos.com/evidence/5b164bff-8ffe-46e2-b493-883b4ed9fed4"},{"id":"324c753c-f3ab-4165-8bd1-eda961278d78","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Provides separate chart extraction for the SG&A waterfall, outputting chart metadata with a title, axis labels, 10 category labels, and a numeric series instead of only inline prose.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/bb341a5637d24cd7b0d5b4c5bb9effb5.png?v=1","evidence_url":"https://aidemos.com/evidence/324c753c-f3ab-4165-8bd1-eda961278d78"},{"id":"e260a099-6895-499f-ab5d-82e11a0cf513","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"worked","score":null,"score_total":null,"note":"Separately extracts chart content into textual summaries and value tables, including a waterfall chart and bar charts with year/value pairs and growth statistics.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/bb341a5637d24cd7b0d5b4c5bb9effb5.png?v=1","evidence_url":"https://aidemos.com/evidence/e260a099-6895-499f-ab5d-82e11a0cf513"}],"other_criteria":[{"id":"19fac25a-166f-48fe-b7a1-bade87256c87","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Flattens a top-level page heading into plain text, losing heading semantics on a page that should read as a structured annual-report story page.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/19fac25a-166f-48fe-b7a1-bade87256c87"},{"id":"e86c0542-0eee-4b42-a6bf-23b72744de0e","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Preserves reading order on a narrative annual-report page by keeping the page title, embedded photo description, paragraphs, and financial-highlights table in sequence.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/e86c0542-0eee-4b42-a6bf-23b72744de0e"},{"id":"967e61c9-53cd-47b4-b6a0-a5ef8eec542a","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Preserves section flow and heading-to-body relationships in a scanned report section, keeping the '19. Commitments and Contingencies' heading and the 'Data Breach' subsection attached to the following paragraphs.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/967e61c9-53cd-47b4-b6a0-a5ef8eec542a"},{"id":"cf877f70-2748-444d-a7fa-54c75d902c97","criterion":"table-preservation","criterion_name":"Table Preservation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a five-year financial results table with the 2015–2011 columns and aligned row/value relationships intact in markdown-style rows.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/cf877f70-2748-444d-a7fa-54c75d902c97"},{"id":"97bf4c42-ab87-4b0a-913c-2823e833dd10","criterion":"visual-content-retention","criterion_name":"Visual Content Retention","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Replaces a waterfall chart with text, preserving the SG&A rate values and year-to-year change labels but not the chart as a visual asset in the output.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/97bf4c42-ab87-4b0a-913c-2823e833dd10"}],"appears_in":[{"page_type":"ranking","slug":"pdf-to-markdown-apis","title":"Best AI Tools to Convert Complex PDFs into Clean Markdown with an API","url":"https://aidemos.com/best/pdf-to-markdown-apis","binding":"run"}],"same_scenario":[{"id":"5b164bff-8ffe-46e2-b493-883b4ed9fed4","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"The separate schema-driven extract.run endpoint cleanly recovers both a financial table and a donut chart: all requested table rows and all five donut percentages come back exactly."},{"id":"324c753c-f3ab-4165-8bd1-eda961278d78","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Provides separate chart extraction for the SG&A waterfall, outputting chart metadata with a title, axis labels, 10 category labels, and a numeric series instead of only inline prose."},{"id":"e260a099-6895-499f-ab5d-82e11a0cf513","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"worked","score":null,"score_total":null,"note":"Separately extracts chart content into textual summaries and value tables, including a waterfall chart and bar charts with year/value pairs and growth statistics."}]}