{"observation":{"id":"71e8765d-9dfb-4578-92cf-fdc93700ad3e","tool":"querio","tool_name":"Querio","criterion":"sql-visibility","criterion_name":"SQL Visibility","criterion_definition":"Can users inspect or copy the generated SQL?","criterion_evidence_type":"capability","criterion_rank_role":null,"criterion_rank_role_reason":null,"scenario":"best-customers-with-unpaid-order-and-payment-method-follow-ups","scenario_name":"Best customers with unpaid-order and payment-method follow-ups","group_tag":"ecommerce-nl2sql-benchmark","scenario_description":"A conversational multi-table customer analysis that identifies best customers by both order volume and spend, then drills into unpaid orders and payment methods for the top 3.","modality":"text","input_text":"Who are my best customers — the ones who order the most and spend the most?\n\nFollow-up 1: For the top 3 from that list — do any of them have unpaid orders?\n\nFollow-up 2: What payment methods do these top 3 usually use?","input_artifact_refs":["AskYourDatabase_Best_Customers_SQL_Visible-2.png","AskYourDatabase_Top_Customers_Unpaid_Orders-2.png","Draxlr_Top_Customers_Payment_Methods.png"],"stresses":["Ambiguous business-term interpretation","Multi-table joins across customers orders and payments","Aggregation and ranking","Follow-up context retention","Scoped drill-down to the top 3 customers","Readable customer-level output"],"verdict":"worked","score":null,"score_total":null,"note":"Shows the generated SQL inline so users can inspect the aggregation and ordering logic, including the GROUP BY and ORDER BY clauses.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/querio-image-6-2d9dfe9cb3e6.png","role":null,"alt":null},{"url":"https://d3epheqghktydj.cloudfront.net/querio-image-7-c39fe8613548.png","role":null,"alt":null}],"run_id":"db2bb5d5-0e0e-4cb3-8d76-3555c45c23cd","study_title":"Query Live Databases Using Plain English with AI","study_kind":"generation","research_task":"86b9y6c99","tested_at":null,"completeness":"input-and-output","input":{"state":"text","text":"Who are my best customers — the ones who order the most and spend the most?\n\nFollow-up 1: For the top 3 from that list — do any of them have unpaid orders?\n\nFollow-up 2: What payment methods do these top 3 usually use?","files":[],"modality":"text","stresses":["Ambiguous business-term interpretation","Multi-table joins across customers orders and payments","Aggregation and ranking","Follow-up context retention","Scoped drill-down to the top 3 customers","Readable customer-level output"]},"tool_page_slug":"querio","tool_url":"https://aidemos.com/tools/querio","permalink":"https://aidemos.com/evidence/71e8765d-9dfb-4578-92cf-fdc93700ad3e","api_url":"https://ai.aidemos.com/v1/observations/71e8765d-9dfb-4578-92cf-fdc93700ad3e"},"peers":[],"other_criteria":[{"id":"8011377c-21bd-4638-be26-4d477a1424f1","criterion":"ambiguity-handling","criterion_name":"Ambiguity Handling","rank_role":null,"verdict":"worked","score":null,"score_total":null,"note":"When the phrase \"best customers\" was ambiguous, it did not guess a single meaning; it split the request into separate order-count and spend rankings.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/8011377c-21bd-4638-be26-4d477a1424f1"},{"id":"d8183a02-f913-4fc4-909b-cea7e4129cdc","criterion":"chart-visualization-support","criterion_name":"Chart / Visualization Support","rank_role":null,"verdict":"worked","score":null,"score_total":null,"note":"Supports visualization on the customer-analysis thread by generating bar-chart views for both spend ranking and order-count ranking.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/d8183a02-f913-4fc4-909b-cea7e4129cdc"},{"id":"f17a5005-134e-4912-8a04-b8fcd44f94dd","criterion":"follow-up-context","criterion_name":"Follow-Up Context","rank_role":null,"verdict":"worked","score":null,"score_total":null,"note":"Carries the top-3 customer identities forward across follow-ups and regenerates fresh SQL on each turn, preserving context correctly across at least two drill-down questions.","artifact_count":3,"evidence_url":"https://aidemos.com/evidence/f17a5005-134e-4912-8a04-b8fcd44f94dd"},{"id":"e2c2aa98-4929-4513-a2fb-47aeb04b5b48","criterion":"plain-english-query-handling","criterion_name":"Plain English Query Handling","rank_role":null,"verdict":"worked","score":null,"score_total":null,"note":"Handles an informal conversational request about top customers without needing the user to translate it into SQL.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/e2c2aa98-4929-4513-a2fb-47aeb04b5b48"},{"id":"47bff1e4-d428-4f7d-98df-6a986d163cd5","criterion":"result-readability","criterion_name":"Result Readability","rank_role":null,"verdict":"mixed","score":null,"score_total":null,"note":"The tables are structurally clear, but using customer UUIDs instead of customer names makes the best-customer results less immediately readable for nontechnical users.","artifact_count":4,"evidence_url":"https://aidemos.com/evidence/47bff1e4-d428-4f7d-98df-6a986d163cd5"}],"appears_in":[{"page_type":"use-case","slug":"query-live-databases","title":"Query Live Databases Using Plain English with AI","url":"https://aidemos.com/use-cases/query-live-databases","binding":"run"},{"page_type":"ranking","slug":"text-to-sql-tools","title":"Best AI Tools to Query Live Databases Using Plain English","url":"https://aidemos.com/best/text-to-sql-tools","binding":"study"}],"same_scenario":[]}