{"observation":{"id":"72e4330d-0ffc-4f08-8d78-f5942daa6a4f","tool":"draxlr","tool_name":"Draxlr","criterion":"chart-visualization-support","criterion_name":"Chart / Visualization Support","criterion_definition":"Does it generate charts automatically or allow useful visual views?","criterion_evidence_type":"capability","criterion_rank_role":null,"criterion_rank_role_reason":null,"scenario":"order-pipeline-breakdown-with-paid-pending-edge-case-and-last-month-comparison","scenario_name":"Order pipeline breakdown with paid-pending edge case and last-month comparison","group_tag":"ecommerce-nl2sql-benchmark","scenario_description":"A deeper operational analysis of current order stages, delivery-versus-cancellation rates, pending-but-paid edge cases, and a month-over-month comparison of the same breakdown.","modality":"text","input_text":"How many orders do we have at each stage right now?\n\nFollow-up 1: What percentage of our orders were successfully delivered vs cancelled?\n\nFollow-up 2: Are there any orders that are pending but already paid?\n\nFollow-up 3: Compare that to last month — same breakdown, I want to see if things have improved or got worse.","input_artifact_refs":["image-2.png"],"stresses":["Order pipeline analysis","Percentage calculation","Edge-case detection","Payment/order status joins","Multi-turn context retention","Month-over-month comparison","Ambiguity handling for 'same breakdown'"],"verdict":"worked","score":null,"score_total":null,"note":"Can auto-generate a correct chart for a simple month-over-month comparison, showing Last Month at 11 pending-paid orders versus Current Month at 20.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/draxlr-image-7-6952f9044037.png","role":null,"alt":null}],"run_id":"db2bb5d5-0e0e-4cb3-8d76-3555c45c23cd","study_title":"Query Live Databases Using Plain English with AI","study_kind":"generation","research_task":"86b9y6c99","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"How many orders do we have at each stage right now?\n\nFollow-up 1: What percentage of our orders were successfully delivered vs cancelled?\n\nFollow-up 2: Are there any orders that are pending but already paid?\n\nFollow-up 3: Compare that to last month — same breakdown, I want to see if things have improved or got worse.","files":[],"modality":"text","stresses":["Order pipeline analysis","Percentage calculation","Edge-case detection","Payment/order status joins","Multi-turn context retention","Month-over-month comparison","Ambiguity handling for 'same breakdown'"]},"tool_page_slug":"draxlr","tool_url":"https://aidemos.com/tools/draxlr","permalink":"https://aidemos.com/evidence/72e4330d-0ffc-4f08-8d78-f5942daa6a4f","api_url":"https://ai.aidemos.com/v1/observations/72e4330d-0ffc-4f08-8d78-f5942daa6a4f"},"peers":[{"id":"202b6ee0-0279-474b-883d-4d71f83eeea7","tool":"askyourdatabase","tool_name":"AskYourDatabase","verdict":"failed","score":null,"score_total":null,"note":"Visualization was not automatic; the report says the tool only produced a visual after an explicit follow-up prompt, so charts were not auto-generated on the initial answers.","artifact_count":2,"thumbnail":"https://d3epheqghktydj.cloudfront.net/askyourdatabase-screenshot-1779337454675-e641d72be4f7.png","evidence_url":"https://aidemos.com/evidence/202b6ee0-0279-474b-883d-4d71f83eeea7"},{"id":"79fec0da-750d-4b9b-b1a4-f85f74d69b29","tool":"definite","tool_name":"Definite","verdict":"mixed","score":null,"score_total":null,"note":"Charts were not generated automatically in the chat; the report says an extra prompt was needed before Definite created a separate dashboard/doc, and the dashboard view shows an 'Orders By Stage' summary with a donut chart.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/definite-image-10-3a427e75002e.png","evidence_url":"https://aidemos.com/evidence/79fec0da-750d-4b9b-b1a4-f85f74d69b29"},{"id":"09c072de-3411-436a-a32a-8fca354c3749","tool":"querio","tool_name":"Querio","verdict":"worked","score":null,"score_total":null,"note":"Automatically generates chart views for the order-stage breakdown and the delivered-vs-cancelled comparison, including the month-over-month share chart.","artifact_count":3,"thumbnail":"https://d3epheqghktydj.cloudfront.net/querio-image-13-5997d74857ce.png","evidence_url":"https://aidemos.com/evidence/09c072de-3411-436a-a32a-8fca354c3749"}],"other_criteria":[{"id":"a37351f9-c20e-4396-aaac-98fda74b1cb5","criterion":"ambiguity-handling","criterion_name":"Ambiguity Handling","rank_role":null,"verdict":"struggled","score":null,"score_total":null,"note":"When a follow-up phrase could refer either to the full order-stage breakdown or to the immediately preceding pending-paid subresult, it did not ask for clarification and instead chose the narrower pending-paid interpretation.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/a37351f9-c20e-4396-aaac-98fda74b1cb5"},{"id":"82eb80c3-8afa-429f-b476-46edd043f78e","criterion":"business-insight","criterion_name":"Business Insight","rank_role":null,"verdict":"worked","score":null,"score_total":null,"note":"Can turn numeric results into plain-English takeaways; the delivered-vs-cancelled follow-up automatically summarized the split and framed delivered orders as more common than cancelled orders.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/82eb80c3-8afa-429f-b476-46edd043f78e"}],"appears_in":[{"page_type":"use-case","slug":"query-live-databases","title":"Query Live Databases Using Plain English with AI","url":"https://aidemos.com/use-cases/query-live-databases","binding":"run"},{"page_type":"ranking","slug":"text-to-sql-tools","title":"Best AI Tools to Query Live Databases Using Plain English","url":"https://aidemos.com/best/text-to-sql-tools","binding":"study"}],"same_scenario":[{"id":"202b6ee0-0279-474b-883d-4d71f83eeea7","tool":"askyourdatabase","tool_name":"AskYourDatabase","verdict":"failed","score":null,"score_total":null,"note":"Visualization was not automatic; the report says the tool only produced a visual after an explicit follow-up prompt, so charts were not auto-generated on the initial answers."},{"id":"79fec0da-750d-4b9b-b1a4-f85f74d69b29","tool":"definite","tool_name":"Definite","verdict":"mixed","score":null,"score_total":null,"note":"Charts were not generated automatically in the chat; the report says an extra prompt was needed before Definite created a separate dashboard/doc, and the dashboard view shows an 'Orders By Stage' summary with a donut chart."},{"id":"09c072de-3411-436a-a32a-8fca354c3749","tool":"querio","tool_name":"Querio","verdict":"worked","score":null,"score_total":null,"note":"Automatically generates chart views for the order-stage breakdown and the delivered-vs-cancelled comparison, including the month-over-month share chart."}]}