{"observation":{"id":"32f69b4e-ce68-451c-ae6d-098434171c49","tool":"draxlr","tool_name":"Draxlr","criterion":"plain-english-query-handling","criterion_name":"Plain English Query Handling","criterion_definition":"Can the tool understand business questions without SQL?","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"This is the core of the ranking: the tool must understand a business question without the user writing SQL. (3 of 3 judges)","scenario":"best-customers-with-unpaid-order-and-payment-method-follow-ups","scenario_name":"Best customers with unpaid-order and payment-method follow-ups","group_tag":"live-database-plain-english-queries","scenario_description":"A conversational multi-table customer analysis with follow-up questions. It asks for the best customers by both order volume and spend, then drills into unpaid orders for the top 3 and their usual payment methods. Designed to test ranking logic, join-heavy analysis, and follow-up context retention.","modality":"text","input_text":"Who are my best customers — the ones who order the most and spend the most?\n\nFollow-up 1: For the top 3 from that list — do any of them have unpaid orders?\n\nFollow-up 2: What payment methods do these top 3 usually use?","input_artifact_refs":[],"stresses":["ambiguous business term interpretation","multi-table joins","aggregation and ranking","follow-up context retention","scoping to a selected subset","payment behavior analysis"],"verdict":"worked","score":null,"score_total":null,"note":"It accepted the informal best-customers request and both follow-up questions across the three-turn conversation.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/ab41b8340d0a45188a25417725b1cede.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/565a041698d44f05ad75ba27fe1fd48d.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/7eb9cf7bac08486788b0654cd98bd538.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/4383ca581d654389b5be7cfffc4eae4c.mp4?v=1","role":"context","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/f11ff2b46e7c4191bfa28036d26e879f.mp4?v=1","role":"output","alt":null}],"run_id":"af2abc96-3311-484b-a19d-854a2fdd2bf3","study_title":"Query Live Databases Using Plain English with AI","study_kind":"generation","research_task":"86b9y6c99","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Who are my best customers — the ones who order the most and spend the most?\n\nFollow-up 1: For the top 3 from that list — do any of them have unpaid orders?\n\nFollow-up 2: What payment methods do these top 3 usually use?","files":[],"modality":"text","stresses":["ambiguous business term interpretation","multi-table joins","aggregation and ranking","follow-up context retention","scoping to a selected subset","payment behavior analysis"]},"tool_page_slug":"draxlr","tool_url":"https://aidemos.com/tools/draxlr","permalink":"https://aidemos.com/evidence/32f69b4e-ce68-451c-ae6d-098434171c49","api_url":"https://ai.aidemos.com/v1/observations/32f69b4e-ce68-451c-ae6d-098434171c49"},"peers":[{"id":"7466b188-0aed-468f-a6fd-245507d99fcc","tool":"askyourdatabase","tool_name":"AskYourDatabase","verdict":"worked","score":null,"score_total":null,"note":"It can interpret informal ranking language like 'the ones who order the most and spend the most' and launch the analysis directly.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/f53605d222624c199b365f4beaf646f5.png?v=1","evidence_url":"https://aidemos.com/evidence/7466b188-0aed-468f-a6fd-245507d99fcc"},{"id":"2bd93ade-7def-4250-ad0a-dd4f54aafd4a","tool":"basedash","tool_name":"Basedash","verdict":"worked","score":null,"score_total":null,"note":"It correctly handled a conversational, multi-part customer question without requiring SQL, producing two rankings plus follow-up answers.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/b32adc19ccfc434bb534d9c3684fee55.png?v=1","evidence_url":"https://aidemos.com/evidence/2bd93ade-7def-4250-ad0a-dd4f54aafd4a"},{"id":"736c4cc8-4b83-445e-b321-4bf1c78cd426","tool":"definite","tool_name":"Definite","verdict":"mixed","score":null,"score_total":null,"note":"It accepted the natural-language request but only ranked customers by total spend, so it did not fully understand the combined 'order the most and spend the most' intent.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/7bb8ca311aef4c5c9a664a5f1df2814c.mp4?v=1","evidence_url":"https://aidemos.com/evidence/736c4cc8-4b83-445e-b321-4bf1c78cd426"},{"id":"56eb0ed0-bf0d-4077-9f04-bd1a290baeb9","tool":"futuresmart-nl2sql-agent","tool_name":"FutureSmart NL2SQL Agent","verdict":"worked","score":null,"score_total":null,"note":"Accepts the best-customers question in plain English and returns a ranked answer without requiring SQL from the user.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/9f6a37e2aa8044c5a801b7b0c1fe9ef9.png?v=1","evidence_url":"https://aidemos.com/evidence/56eb0ed0-bf0d-4077-9f04-bd1a290baeb9"},{"id":"78125c79-ab09-4a31-9c8e-246e8474d64b","tool":"querio","tool_name":"Querio","verdict":"worked","score":null,"score_total":null,"note":"Handles an informal conversational request and splits 'order the most' and 'spend the most' into two separate ranking dimensions instead of guessing.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/364651fb80d04b7299109e6465d39e8d.png?v=1","evidence_url":"https://aidemos.com/evidence/78125c79-ab09-4a31-9c8e-246e8474d64b"}],"other_criteria":[{"id":"c476bbbb-1bf9-4efe-bdc1-3098a868877c","criterion":"ambiguity-handling","criterion_name":"Ambiguity Handling","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"It resolved the vague phrase best customers as highest order count plus highest total spend instead of asking for a definition.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/c476bbbb-1bf9-4efe-bdc1-3098a868877c"},{"id":"d2139d74-3e9f-4b36-a3f8-519598bf53d9","criterion":"business-insight","criterion_name":"Business Insight","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"It produced query descriptions, but no after-the-table narrative that distilled the result into a takeaway like which top customer had unpaid orders.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/d2139d74-3e9f-4b36-a3f8-519598bf53d9"},{"id":"1c7f2960-e2a9-4aa3-9dee-dc969f6f3371","criterion":"follow-up-context","criterion_name":"Follow-Up Context","rank_role":"context","verdict":"worked","score":null,"score_total":null,"note":"It kept the top 3 from that list context intact across both follow-ups and continued analyzing the same three customers.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/1c7f2960-e2a9-4aa3-9dee-dc969f6f3371"},{"id":"492b3c4c-2b5a-42db-80b7-7b8f2464e506","criterion":"result-readability","criterion_name":"Result Readability","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"All three best-customer result tables keep customer_id as the lead column, so the output stays UUID-heavy and hard to scan.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/492b3c4c-2b5a-42db-80b7-7b8f2464e506"},{"id":"4e02ad7d-1469-43d8-a397-ee2961f2a39d","criterion":"sql-generation","criterion_name":"SQL Generation","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Across the three turns it generated production-grade SQL, including ranking logic, unpaid-order checks, and payment-method aggregation with CTEs, ROW_NUMBER, COALESCE, and LEFT JOIN.","artifact_count":4,"evidence_url":"https://aidemos.com/evidence/4e02ad7d-1469-43d8-a397-ee2961f2a39d"}],"appears_in":[{"page_type":"ranking","slug":"ai-database-query-tools","title":"Best AI Tools to Query Live Databases Using Plain English","url":"https://aidemos.com/best/ai-database-query-tools","binding":"run"},{"page_type":"ranking","slug":"text-to-sql-tools","title":"Best AI Tools to Query Live Databases Using Plain English","url":"https://aidemos.com/best/text-to-sql-tools","binding":"study"},{"page_type":"use-case","slug":"query-live-databases","title":"Query Live Databases Using Plain English with AI","url":"https://aidemos.com/use-cases/query-live-databases","binding":"study"}],"same_scenario":[{"id":"7466b188-0aed-468f-a6fd-245507d99fcc","tool":"askyourdatabase","tool_name":"AskYourDatabase","verdict":"worked","score":null,"score_total":null,"note":"It can interpret informal ranking language like 'the ones who order the most and spend the most' and launch the analysis directly."},{"id":"2bd93ade-7def-4250-ad0a-dd4f54aafd4a","tool":"basedash","tool_name":"Basedash","verdict":"worked","score":null,"score_total":null,"note":"It correctly handled a conversational, multi-part customer question without requiring SQL, producing two rankings plus follow-up answers."},{"id":"736c4cc8-4b83-445e-b321-4bf1c78cd426","tool":"definite","tool_name":"Definite","verdict":"mixed","score":null,"score_total":null,"note":"It accepted the natural-language request but only ranked customers by total spend, so it did not fully understand the combined 'order the most and spend the most' intent."},{"id":"56eb0ed0-bf0d-4077-9f04-bd1a290baeb9","tool":"futuresmart-nl2sql-agent","tool_name":"FutureSmart NL2SQL Agent","verdict":"worked","score":null,"score_total":null,"note":"Accepts the best-customers question in plain English and returns a ranked answer without requiring SQL from the user."},{"id":"78125c79-ab09-4a31-9c8e-246e8474d64b","tool":"querio","tool_name":"Querio","verdict":"worked","score":null,"score_total":null,"note":"Handles an informal conversational request and splits 'order the most' and 'spend the most' into two separate ranking dimensions instead of guessing."}]}