{"observation":{"id":"e86e674e-4666-4abc-a7fb-84d1f4bf1ed7","tool":"tensorlake","tool_name":"Tensorlake","criterion":"table-preservation","criterion_name":"Table Preservation","criterion_definition":"Preserves complex table structures, including rows, columns, multi-row headers, and merged-cell relationships in markdown.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Accurate Markdown conversion of complex PDFs depends on keeping table structure intact, not flattening it into plain text. (3 of 3 judges)","scenario":"financial-report-table-heavy","scenario_name":"Financial Report - Table Heavy","group_tag":"financial-report-table-heavy","scenario_description":"A table-heavy corporate financial report used to test extraction of dense, hierarchical financial statements with grouped columns, multi-row headers, segment-reporting tables, and narrative disclosures.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/fba42ade5adb4814a3381dd4487a3910.pdf?v=1","role":"input","filename":"doc.pdf"}],"stresses":["Multi-page financial statement extraction","Hierarchical table reconstruction","Grouped columns and multi-row headers","Reading order in a report with mixed narrative and tables","Document structure retention","Markdown usability"],"verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a multilevel segment-results table with grouped previous/present quarter headers, year-over-year change columns, six segment rows, and a total row.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/7e4a0f994215484c920ba868f35fcef4.png?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/13fdaf6218ff48a79aaf8644486e52bf.png?v=1","role":"output","alt":null}],"run_id":"6e3160de-fe46-4b45-b071-72560b5c5d0e","study_title":"Convert a Complex PDF into Clean Markdown with an API","study_kind":"generation","research_task":"86b9h7t37","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/fba42ade5adb4814a3381dd4487a3910.pdf?v=1","filename":"doc.pdf","alt":"Financial Report - Table Heavy","role":"input"}],"modality":"pdf","stresses":["Multi-page financial statement extraction","Hierarchical table reconstruction","Grouped columns and multi-row headers","Reading order in a report with mixed narrative and tables","Document structure retention","Markdown usability"]},"tool_page_slug":"tensorlake","tool_url":"https://aidemos.com/tools/tensorlake","permalink":"https://aidemos.com/evidence/e86e674e-4666-4abc-a7fb-84d1f4bf1ed7","api_url":"https://ai.aidemos.com/v1/observations/e86e674e-4666-4abc-a7fb-84d1f4bf1ed7"},"peers":[{"id":"e2b44c75-a82d-4254-8add-2ed4da971cda","tool":"adobe-api","tool_name":"Adobe API","verdict":"failed","score":null,"score_total":null,"note":"Flattens a dual-header financial table, losing the distinct row-header versus column-header roles in the extracted version.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/42af0b6a8200417588083a90fa79bbc7.png?v=1","evidence_url":"https://aidemos.com/evidence/e2b44c75-a82d-4254-8add-2ed4da971cda"},{"id":"97730664-06e4-4f6f-934a-dcb55b7fe176","tool":"extend-ai","tool_name":"Extend AI","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the body rows aligned in a multilevel table, but fails to split compound header cells cleanly, so header roles are partially flattened.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/99105bf764b54991bbcea2ecf47fbb52.png?v=1","evidence_url":"https://aidemos.com/evidence/97730664-06e4-4f6f-934a-dcb55b7fe176"},{"id":"3e92e668-2248-45fe-bbe3-3bbe48017ea9","tool":"landing-ai","tool_name":"Landing AI","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a multi-column segment comparison table with previous-year, present-year, and year-over-year change columns aligned across the rows.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7e4a0f994215484c920ba868f35fcef4.png?v=1","evidence_url":"https://aidemos.com/evidence/3e92e668-2248-45fe-bbe3-3bbe48017ea9"},{"id":"b83ea780-c133-4101-8a90-10799b20ab97","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Preserves a multi-level segment-results table with grouped headers and year-over-year columns, keeping the hierarchy legible in the extracted output.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/808bccab0f4e4188ad2e46b4a0124763.png?v=1","evidence_url":"https://aidemos.com/evidence/b83ea780-c133-4101-8a90-10799b20ab97"},{"id":"fa59d041-14d6-4e87-b31a-efb38ba1ca3d","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"The multilevel segment table is preserved with its hierarchical headers intact, maintaining the relationships between the grouped columns and their values.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7e4a0f994215484c920ba868f35fcef4.png?v=1","evidence_url":"https://aidemos.com/evidence/fa59d041-14d6-4e87-b31a-efb38ba1ca3d"},{"id":"a86ffd95-175a-40ec-8670-6791368379df","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"failed","score":null,"score_total":null,"note":"Loses multi-level header organization in hierarchical tables, so parent-child column relationships are not reconstructed in the markdown output.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/33be110e75ed4e7ca9c753431c9ecf0c.png?v=1","evidence_url":"https://aidemos.com/evidence/a86ffd95-175a-40ec-8670-6791368379df"},{"id":"8c8cffd6-9942-4cc3-95c3-b837dfd045e3","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"Preserves the balance-sheet hierarchy and values, including Assets > Current assets > Cash and deposits, and also reconstructs the later 9-column segment table with all values correct.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/ae13c7e19e8b412abc1f87bcc21554f3.png?v=1","evidence_url":"https://aidemos.com/evidence/8c8cffd6-9942-4cc3-95c3-b837dfd045e3"},{"id":"c66e2b14-a549-4ce7-bbd9-4f0fb50a2057","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"failed","score":null,"score_total":null,"note":"Misaligns column headers with data regions in dense financial tables, producing a structurally inconsistent balance-sheet extraction rather than a clean header-to-row mapping.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/06a0e21888cc4bb187dec34ceb255186.png?v=1","evidence_url":"https://aidemos.com/evidence/c66e2b14-a549-4ce7-bbd9-4f0fb50a2057"}],"other_criteria":[{"id":"79747d1f-4b06-48ae-b43f-512e9c2d1465","criterion":"complex-document-handling","criterion_name":"Complex Document Handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Handles a table-heavy 18-page report with numerous tables while keeping the extracted sections aligned to the document flow.","artifact_count":4,"evidence_url":"https://aidemos.com/evidence/79747d1f-4b06-48ae-b43f-512e9c2d1465"},{"id":"517504c5-f1cc-4741-acfb-c00b4f29897f","criterion":"markdown-quality","criterion_name":"Markdown Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Returns the extraction as structured markdown in the Document Markdown workflow, making the output usable rather than a raw text dump.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/517504c5-f1cc-4741-acfb-c00b4f29897f"},{"id":"9bb6f16e-5cab-4c4b-86e7-adcc09d97654","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Keeps section ordering and narrative flow in an 18-page table-heavy financial report, preserving the operating-performance section before the tabular disclosures.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/9bb6f16e-5cab-4c4b-86e7-adcc09d97654"}],"appears_in":[{"page_type":"ranking","slug":"pdf-to-markdown-apis","title":"Best AI Tools to Convert Complex PDFs into Clean Markdown with an API","url":"https://aidemos.com/best/pdf-to-markdown-apis","binding":"run"}],"same_scenario":[{"id":"e2b44c75-a82d-4254-8add-2ed4da971cda","tool":"adobe-api","tool_name":"Adobe API","verdict":"failed","score":null,"score_total":null,"note":"Flattens a dual-header financial table, losing the distinct row-header versus column-header roles in the extracted version."},{"id":"97730664-06e4-4f6f-934a-dcb55b7fe176","tool":"extend-ai","tool_name":"Extend AI","verdict":"mixed","score":null,"score_total":null,"note":"Keeps the body rows aligned in a multilevel table, but fails to split compound header cells cleanly, so header roles are partially flattened."},{"id":"3e92e668-2248-45fe-bbe3-3bbe48017ea9","tool":"landing-ai","tool_name":"Landing AI","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a multi-column segment comparison table with previous-year, present-year, and year-over-year change columns aligned across the rows."},{"id":"b83ea780-c133-4101-8a90-10799b20ab97","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Preserves a multi-level segment-results table with grouped headers and year-over-year columns, keeping the hierarchy legible in the extracted output."},{"id":"fa59d041-14d6-4e87-b31a-efb38ba1ca3d","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"The multilevel segment table is preserved with its hierarchical headers intact, maintaining the relationships between the grouped columns and their values."},{"id":"a86ffd95-175a-40ec-8670-6791368379df","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"failed","score":null,"score_total":null,"note":"Loses multi-level header organization in hierarchical tables, so parent-child column relationships are not reconstructed in the markdown output."},{"id":"8c8cffd6-9942-4cc3-95c3-b837dfd045e3","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"Preserves the balance-sheet hierarchy and values, including Assets > Current assets > Cash and deposits, and also reconstructs the later 9-column segment table with all values correct."},{"id":"c66e2b14-a549-4ce7-bbd9-4f0fb50a2057","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"failed","score":null,"score_total":null,"note":"Misaligns column headers with data regions in dense financial tables, producing a structurally inconsistent balance-sheet extraction rather than a clean header-to-row mapping."}]}