{"observation":{"id":"a934b0f5-a5d5-4010-ba03-f6729c0c3df0","tool":"studyx-ai","tool_name":"StudyX AI","criterion":"does-it-feel-like-a-real-quiz","criterion_name":"Does It Feel Like a Real Quiz?","criterion_definition":"Whether the tool provides a proper interactive quiz-taking experience with scoring, feedback, timers, and answer review instead of just displaying questions and answers.","criterion_evidence_type":"capability","criterion_rank_role":"decisive","criterion_rank_role_reason":"Practice tests are not just question lists; scoring, feedback, timers, and review are part of whether the tool really delivers the quiz experience the reader wants. (3 of 3 judges)","scenario":"ncert-class-12-biology-chapter-pdf-on-sexual-reproduction-in-flowering-plants","scenario_name":"NCERT Class 12 Biology chapter PDF on sexual reproduction in flowering plants","group_tag":"sexual-reproduction-in-flowering-plants","scenario_description":"A dense typed NCERT Class 12 Biology chapter on sexual reproduction in flowering plants, including technical terminology and diagrams. It was used to test how well tools extract content and generate high-quality questions from a long, structured study PDF.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/generate-quizzes-and-practice-tests-from-input1-primary-366aec5861ae.pdf","role":"input","filename":"input1_primary.pdf"}],"stresses":["long-form document extraction","technical biology terminology","diagram-heavy content","question generation quality from clean typed text"],"verdict":"mixed","score":null,"score_total":null,"note":"Provides 2 key quiz cues — answers are hidden by default and a score tracker updates — but 0 enforced gates stop the user from revealing answers before attempting them, so the quiz feels interactive without being locked down.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/d6d72d8e70264f7ba5268496dc3b2137.png?v=1","role":"output","alt":null},{"url":"https://cdn.futuresmart.ai/public/aidemos/e764b526dd614d4b938562ed4a924dfe.png?v=1","role":"output","alt":null}],"run_id":"de7b348e-4326-4fbf-87c1-b104750bc459","study_title":"Generate Quizzes and Practice Tests from Study Material Using AI","study_kind":"generation","research_task":"86ba51dce","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/generate-quizzes-and-practice-tests-from-input1-primary-366aec5861ae.pdf","filename":"input1_primary.pdf","alt":"NCERT Class 12 Biology chapter PDF on sexual reproduction in flowering plants","role":"input"}],"modality":"pdf","stresses":["long-form document extraction","technical biology terminology","diagram-heavy content","question generation quality from clean typed text"]},"tool_page_slug":"studyx-ai","tool_url":"https://aidemos.com/tools/studyx-ai","permalink":"https://aidemos.com/evidence/a934b0f5-a5d5-4010-ba03-f6729c0c3df0","api_url":"https://ai.aidemos.com/v1/observations/a934b0f5-a5d5-4010-ba03-f6729c0c3df0"},"peers":[],"other_criteria":[{"id":"c09ec537-a8cf-45d7-addc-b7ff9a78d718","criterion":"are-the-questions-actually-good","criterion_name":"Are the Questions Actually Good?","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Generates strong 4-option MCQs with closely related distractors that are hard to eliminate by pattern matching; in the PDF run, the double-fertilization question shows concept-level options rather than obvious throwaways.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/c09ec537-a8cf-45d7-addc-b7ff9a78d718"},{"id":"2c71d274-9808-4780-9616-334c59a8aa18","criterion":"are-the-questions-actually-good","criterion_name":"Are the Questions Actually Good?","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"The chat-based reframe feature upgrades a plain MCQ into a more applied, scenario-based question while keeping the same biology concept and answer choices aligned to the chapter.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/2c71d274-9808-4780-9616-334c59a8aa18"},{"id":"f98d3c36-275e-4e98-91a9-56f5a685bcfc","criterion":"are-the-questions-actually-good","criterion_name":"Are the Questions Actually Good?","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Can generate 15 non-MCQ practice items only through a manual chat prompt: 5 true/false, 5 fill-in-the-blanks, and 5 short-answer questions, with an answer key requested in the same prompt. That expands format variety, but it is not native quiz generation and costs extra credits.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/f98d3c36-275e-4e98-91a9-56f5a685bcfc"},{"id":"314342e1-9466-4e08-a1bd-18f21c16a336","criterion":"can-it-read-your-material","criterion_name":"Can It Read Your Material?","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"Successfully ingests a dense typed chapter PDF and turns it into a full 20-question botany quiz; the output shows later items from Question 2 through Question 19 with chapter-specific content such as geitonogamy, androecium, embryo sac structures, and scutellum.","artifact_count":2,"evidence_url":"https://aidemos.com/evidence/314342e1-9466-4e08-a1bd-18f21c16a336"}],"appears_in":[{"page_type":"ranking","slug":"quiz-generators","title":"Best AI Tools for Generating Quizzes and Practice Tests from Study Material","url":"https://aidemos.com/best/quiz-generators","binding":"run"},{"page_type":"tool","slug":"doctoquiz","title":null,"url":"https://aidemos.com/tools/doctoquiz","binding":"run"}],"same_scenario":[]}