{"observation":{"id":"4b038978-b3f2-43fd-9e75-cde4cc754c4e","tool":"adobe-api","tool_name":"Adobe API","criterion":"table-preservation","criterion_name":"Table Preservation","criterion_definition":"Preserves complex table structures, including rows, columns, multi-row headers, and merged-cell relationships in markdown.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Accurate Markdown conversion of complex PDFs depends on keeping table structure intact, not flattening it into plain text. (3 of 3 judges)","scenario":"hybrid-earnings-report","scenario_name":"Hybrid Earnings Report","group_tag":"hybrid-earnings-report","scenario_description":"A long, real-world hybrid annual report used to benchmark end-to-end PDF-to-markdown conversion. It combines native text, financial tables, charts/graphics, and scanned signature/stamp regions, stressing preservation of document structure, reading order, and embedded visual content across a multi-section report.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://cdn.futuresmart.ai/public/aidemos/f63a44b441704753b65d1b89dc9b4bbb.pdf?v=1","role":"input","filename":"Target-2015-Annual-Report.pdf"}],"stresses":["Native digital text extraction","Complex financial table preservation","Chart and graphic retention","Image-based signatures and stamps","Reading order across a long multi-section report","Markdown quality and consistency"],"verdict":"mixed","score":null,"score_total":null,"note":"Retains the 2-column 'Other Noncurrent Assets' table but formats the currency symbols awkwardly around the values, showing a presentation-level mismatch even though the row data remains present.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/b2471a2784864cc6961e1d6da79d3d0d.png?v=1","role":"input","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/475fbbe825be44f8aa89684a356193db.png?v=1","role":"output","alt":null}],"run_id":"6e3160de-fe46-4b45-b071-72560b5c5d0e","study_title":"Convert a Complex PDF into Clean Markdown with an API","study_kind":"generation","research_task":"86b9h7t37","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://cdn.futuresmart.ai/public/aidemos/f63a44b441704753b65d1b89dc9b4bbb.pdf?v=1","filename":"Target-2015-Annual-Report.pdf","alt":"Hybrid Earnings Report","role":"input"}],"modality":"pdf","stresses":["Native digital text extraction","Complex financial table preservation","Chart and graphic retention","Image-based signatures and stamps","Reading order across a long multi-section report","Markdown quality and consistency"]},"tool_page_slug":"adobe-api","tool_url":"https://aidemos.com/tools/adobe-api","permalink":"https://aidemos.com/evidence/4b038978-b3f2-43fd-9e75-cde4cc754c4e","api_url":"https://ai.aidemos.com/v1/observations/4b038978-b3f2-43fd-9e75-cde4cc754c4e"},"peers":[{"id":"f09929e3-569b-4cc1-8a0e-f0dff9b4279c","tool":"extend-ai","tool_name":"Extend AI","verdict":"worked","score":null,"score_total":null,"note":"Preserves a 5-year financial summary table with row labels and year columns aligned, keeping the annual financial grid intact in markdown.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6596808a677a4687be77b6a950dfb62c.png?v=1","evidence_url":"https://aidemos.com/evidence/f09929e3-569b-4cc1-8a0e-f0dff9b4279c"},{"id":"cf877f70-2748-444d-a7fa-54c75d902c97","tool":"landing-ai","tool_name":"Landing AI","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a five-year financial results table with the 2015–2011 columns and aligned row/value relationships intact in markdown-style rows.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6596808a677a4687be77b6a950dfb62c.png?v=1","evidence_url":"https://aidemos.com/evidence/cf877f70-2748-444d-a7fa-54c75d902c97"},{"id":"ec2a6be9-2fa7-4dfe-9ba5-5bb0de6edc95","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Preserves aligned rows, columns, and value associations in a standard multi-year financial summary table.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b9ea1c5a985440c9a492afd056137c7c.png?v=1","evidence_url":"https://aidemos.com/evidence/ec2a6be9-2fa7-4dfe-9ba5-5bb0de6edc95"},{"id":"e8c8bbc3-204e-4a77-b1ed-b025c3f77ac0","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"The financial table is reconstructed into a usable structured layout without losing the relationships between headers, rows, and corresponding values.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6596808a677a4687be77b6a950dfb62c.png?v=1","evidence_url":"https://aidemos.com/evidence/e8c8bbc3-204e-4a77-b1ed-b025c3f77ac0"},{"id":"8d940f0a-8cce-4f85-9988-d75adbb9b1a8","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"failed","score":null,"score_total":null,"note":"Breaks a 5-year financial summary table, misaligning rows, columns, and values instead of reconstructing the original structure cleanly.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6596808a677a4687be77b6a950dfb62c.png?v=1","evidence_url":"https://aidemos.com/evidence/8d940f0a-8cce-4f85-9988-d75adbb9b1a8"},{"id":"95351b6f-5f39-4442-81c6-7e668e79d68f","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"Preserves a genuinely row-paired 52-row state table as a clean grid, keeping the 1,792 stores total and 239,539 retail-square-footage total intact.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/3dcfa3e88ab74f038ec4389001069356.png?v=1","evidence_url":"https://aidemos.com/evidence/95351b6f-5f39-4442-81c6-7e668e79d68f"},{"id":"efc88dd3-8f40-4863-ade4-566f307265b5","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Keeps a 5-year financial summary table structured, retaining the row/column relationships across sales, expenses, EBIT, and per-share rows instead of flattening the table.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6596808a677a4687be77b6a950dfb62c.png?v=1","evidence_url":"https://aidemos.com/evidence/efc88dd3-8f40-4863-ade4-566f307265b5"},{"id":"eadd62f1-5229-47c5-9d69-024cbf87e51b","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"mixed","score":null,"score_total":null,"note":"Reconstructs the 2011–2015 financial summary table with rows and columns intact, but misses a small number of currency symbols in the extracted values.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/6596808a677a4687be77b6a950dfb62c.png?v=1","evidence_url":"https://aidemos.com/evidence/eadd62f1-5229-47c5-9d69-024cbf87e51b"}],"other_criteria":[{"id":"b6400536-c5b3-4232-860e-82a4570ba4fb","criterion":"complex-document-handling","criterion_name":"Complex Document Handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Processes a long mixed-content annual report in one automated run, keeping tables, charts, and scanned signature pages in the extracted output.","artifact_count":6,"evidence_url":"https://aidemos.com/evidence/b6400536-c5b3-4232-860e-82a4570ba4fb"},{"id":"f9dd710a-724a-40da-a8b5-56464ee25af3","criterion":"visual-content-retention","criterion_name":"Visual Content Retention","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Keeps embedded charts and segment graphics inside the report page rather than dropping them, so the extracted page still shows the financial-highlights block and segment-sales graphics.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/f9dd710a-724a-40da-a8b5-56464ee25af3"},{"id":"5a2c32cc-14a5-43f9-b805-dc8dd67cd337","criterion":"visual-content-retention","criterion_name":"Visual Content Retention","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Drops handwritten signature images from a scanned signatures page while retaining the surrounding printed legal text, so the signature content is missing from the extracted output.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/5a2c32cc-14a5-43f9-b805-dc8dd67cd337"}],"appears_in":[{"page_type":"ranking","slug":"pdf-to-markdown-apis","title":"Best AI Tools to Convert Complex PDFs into Clean Markdown with an API","url":"https://aidemos.com/best/pdf-to-markdown-apis","binding":"run"}],"same_scenario":[{"id":"f09929e3-569b-4cc1-8a0e-f0dff9b4279c","tool":"extend-ai","tool_name":"Extend AI","verdict":"worked","score":null,"score_total":null,"note":"Preserves a 5-year financial summary table with row labels and year columns aligned, keeping the annual financial grid intact in markdown."},{"id":"cf877f70-2748-444d-a7fa-54c75d902c97","tool":"landing-ai","tool_name":"Landing AI","verdict":"worked","score":null,"score_total":null,"note":"Reconstructs a five-year financial results table with the 2015–2011 columns and aligned row/value relationships intact in markdown-style rows."},{"id":"ec2a6be9-2fa7-4dfe-9ba5-5bb0de6edc95","tool":"llamaparse","tool_name":"LlamaParse","verdict":"worked","score":null,"score_total":null,"note":"Preserves aligned rows, columns, and value associations in a standard multi-year financial summary table."},{"id":"e8c8bbc3-204e-4a77-b1ed-b025c3f77ac0","tool":"mistral-ai","tool_name":"Mistral AI","verdict":"worked","score":null,"score_total":null,"note":"The financial table is reconstructed into a usable structured layout without losing the relationships between headers, rows, and corresponding values."},{"id":"8d940f0a-8cce-4f85-9988-d75adbb9b1a8","tool":"nutrient-io","tool_name":"Nutrient.io","verdict":"failed","score":null,"score_total":null,"note":"Breaks a 5-year financial summary table, misaligning rows, columns, and values instead of reconstructing the original structure cleanly."},{"id":"95351b6f-5f39-4442-81c6-7e668e79d68f","tool":"reducto","tool_name":"Reducto","verdict":"worked","score":null,"score_total":null,"note":"Preserves a genuinely row-paired 52-row state table as a clean grid, keeping the 1,792 stores total and 239,539 retail-square-footage total intact."},{"id":"efc88dd3-8f40-4863-ade4-566f307265b5","tool":"tensorlake","tool_name":"Tensorlake","verdict":"worked","score":null,"score_total":null,"note":"Keeps a 5-year financial summary table structured, retaining the row/column relationships across sales, expenses, EBIT, and per-share rows instead of flattening the table."},{"id":"eadd62f1-5229-47c5-9d69-024cbf87e51b","tool":"upstage-ai","tool_name":"Upstage AI","verdict":"mixed","score":null,"score_total":null,"note":"Reconstructs the 2011–2015 financial summary table with rows and columns intact, but misses a small number of currency symbols in the extracted values."}]}