{"observation":{"id":"245a23d8-809d-40ba-9dbf-d685e2c54740","tool":"mistral-ai","tool_name":"Mistral AI","criterion":"complex-document-handling","criterion_name":"Complex Document Handling","criterion_definition":"Maintains quality across long, multi-section, and mixed-content documents without degradation.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"The subject explicitly says complex PDF, so sustained quality across long, mixed-content documents is central to the tool’s ability to do the job. (3 of 3 judges)","scenario":"financial-report-table-heavy","scenario_name":"Financial Report - Table Heavy","group_tag":"financial-report-table-heavy","scenario_description":"A table-heavy corporate financial report used to test extraction of dense, hierarchical financial statements with grouped columns, multi-row headers, segment-reporting tables, and narrative disclosures.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/fba42ade5adb4814a3381dd4487a3910.pdf?v=1","role":"input","filename":"doc.pdf"}],"stresses":["Multi-page financial statement extraction","Hierarchical table reconstruction","Grouped columns and multi-row headers","Reading order in a report with mixed narrative and tables","Document structure retention","Markdown usability"],"verdict":"worked","score":null,"score_total":null,"note":"The tool processes an 18-page table-heavy financial report end-to-end and returns both page-level and consolidated markdown outputs.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/902da5f0b74c4f998cc4d342ecd69b54.mp4?v=1","role":"context","alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/research-media-mistral-ai-financial-pdf-output-zip-file-d15fc30bd9c4.zip","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/b12d5cd772a647818ad1833789b090d6.pdf?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/9bfebcca73f44a08ae4dbfeb7b27552a.mp4?v=1","role":"context","alt":null}],"run_id":"6e3160de-fe46-4b45-b071-72560b5c5d0e","study_title":"Convert a Complex PDF into Clean Markdown with an API","study_kind":"generation","research_task":"86b9h7t37","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/fba42ade5adb4814a3381dd4487a3910.pdf?v=1","filename":"doc.pdf","alt":"Financial Report - Table Heavy","role":"input"}],"modality":"pdf","stresses":["Multi-page financial statement extraction","Hierarchical table reconstruction","Grouped columns and multi-row headers","Reading order in a report with mixed narrative and tables","Document structure retention","Markdown usability"]},"tool_page_slug":"mistral-ai","tool_url":"https://aidemos.com/tools/mistral-ai","permalink":"https://aidemos.com/evidence/245a23d8-809d-40ba-9dbf-d685e2c54740","api_url":"https://ai.aidemos.com/v1/observations/245a23d8-809d-40ba-9dbf-d685e2c54740"},"peers":[{"id":"44a2ca92-39b0-422f-ac7d-6d7cfbfc36b7","tool":"adobe-api","tool_name":"Adobe API","verdict":"worked","score":null,"score_total":null,"note":"Processes a multi-section, table-heavy financial report in one automated run and returns structured Markdown output.","artifact_count":6,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b12d5cd772a647818ad1833789b090d6.pdf?v=1","evidence_url":"https://aidemos.com/evidence/44a2ca92-39b0-422f-ac7d-6d7cfbfc36b7"},{"id":"01db8269-95b5-4b83-a72d-bd40db331992","tool":"extend-ai","tool_name":"Extend AI","verdict":"worked","score":null,"score_total":null,"note":"Processes the 18-page table-heavy financial report end-to-end and returns usable markdown without manual correction.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b12d5cd772a647818ad1833789b090d6.pdf?v=1","evidence_url":"https://aidemos.com/evidence/01db8269-95b5-4b83-a72d-bd40db331992"},{"id":"c2b3fb59-2c32-4edb-a21b-125cb364f2ea","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Processes an 18-page table-heavy report end-to-end and reaches SUCCESS in the Results view without manual correction.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/a2971f8886a1408bb74c1a0fd3acb1a1.mp4?v=1","evidence_url":"https://aidemos.com/evidence/c2b3fb59-2c32-4edb-a21b-125cb364f2ea"},{"id":"e6305cde-5b3c-4eda-bdc9-83b05fbcfb79","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"worked","score":null,"score_total":null,"note":"Handles an 18-page table-heavy financial report and returns a parsed markdown output plus preview, showing end-to-end extraction on a dense corporate document.","artifact_count":6,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b12d5cd772a647818ad1833789b090d6.pdf?v=1","evidence_url":"https://aidemos.com/evidence/e6305cde-5b3c-4eda-bdc9-83b05fbcfb79"},{"id":"bfda059c-a8f9-41ce-8796-bcc01ea2026d","tool":"reducto","tool_name":"Reducto","verdict":"mixed","score":null,"score_total":null,"note":"Processes the 18-page report in 9.7 seconds with no truncation; the 9-column segment table at page 17 is flawless even though the first table on page 2 is broken.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/research-media-reducto-input2-financialpdf-output-d0513091b86a.md","evidence_url":"https://aidemos.com/evidence/bfda059c-a8f9-41ce-8796-bcc01ea2026d"},{"id":"79747d1f-4b06-48ae-b43f-512e9c2d1465","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Handles a table-heavy 18-page report with numerous tables while keeping the extracted sections aligned to the document flow.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/4a1b21a5855f4064b049eaf39823a417.png?v=1","evidence_url":"https://aidemos.com/evidence/79747d1f-4b06-48ae-b43f-512e9c2d1465"}],"other_criteria":[{"id":"9c7a0e04-472d-43b7-a08c-8cba8763be40","criterion":"markdown-quality","criterion_name":"Markdown Quality","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The output is organized as a downloadable ZIP containing a consolidated markdown document plus individual page-level files for localized inspection.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/9c7a0e04-472d-43b7-a08c-8cba8763be40"},{"id":"1b28b2b5-cfd9-48db-82e9-11ad35d536f4","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Document hierarchy and reading flow are preserved across the financial report, with headings staying connected to their explanatory text in the reconstructed output.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/1b28b2b5-cfd9-48db-82e9-11ad35d536f4"},{"id":"16adbd4c-8e66-485d-9c8a-4c463d4aa966","criterion":"reading-order-structure","criterion_name":"Reading Order & Structure","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The table of contents is flattened into raw text, so the original navigational hierarchy is not preserved.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/16adbd4c-8e66-485d-9c8a-4c463d4aa966"},{"id":"fa59d041-14d6-4e87-b31a-efb38ba1ca3d","criterion":"table-preservation","criterion_name":"Table Preservation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The multilevel segment table is preserved with its hierarchical headers intact, maintaining the relationships between the grouped columns and their values.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/fa59d041-14d6-4e87-b31a-efb38ba1ca3d"},{"id":"5fe802fc-62a5-4a6a-aa9c-9ae77852cde1","criterion":"table-preservation","criterion_name":"Table Preservation","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Distinct header levels are collapsed into a single cell in the multilevel table, weakening the parent-child relationships that define the column semantics.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/5fe802fc-62a5-4a6a-aa9c-9ae77852cde1"}],"appears_in":[{"page_type":"ranking","slug":"pdf-to-markdown-apis","title":"Best AI Tools to Convert Complex PDFs into Clean Markdown with an API","url":"https://aidemos.com/best/pdf-to-markdown-apis","binding":"run"}],"same_scenario":[{"id":"44a2ca92-39b0-422f-ac7d-6d7cfbfc36b7","tool":"adobe-api","tool_name":"Adobe API","verdict":"worked","score":null,"score_total":null,"note":"Processes a multi-section, table-heavy financial report in one automated run and returns structured Markdown output."},{"id":"01db8269-95b5-4b83-a72d-bd40db331992","tool":"extend-ai","tool_name":"Extend AI","verdict":"worked","score":null,"score_total":null,"note":"Processes the 18-page table-heavy financial report end-to-end and returns usable markdown without manual correction."},{"id":"c2b3fb59-2c32-4edb-a21b-125cb364f2ea","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Processes an 18-page table-heavy report end-to-end and reaches SUCCESS in the Results view without manual correction."},{"id":"e6305cde-5b3c-4eda-bdc9-83b05fbcfb79","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"worked","score":null,"score_total":null,"note":"Handles an 18-page table-heavy financial report and returns a parsed markdown output plus preview, showing end-to-end extraction on a dense corporate document."},{"id":"bfda059c-a8f9-41ce-8796-bcc01ea2026d","tool":"reducto","tool_name":"Reducto","verdict":"mixed","score":null,"score_total":null,"note":"Processes the 18-page report in 9.7 seconds with no truncation; the 9-column segment table at page 17 is flawless even though the first table on page 2 is broken."},{"id":"79747d1f-4b06-48ae-b43f-512e9c2d1465","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Handles a table-heavy 18-page report with numerous tables while keeping the extracted sections aligned to the document flow."}]}