{"observation":{"id":"dde36703-9bde-4a45-98fd-65364d85e81a","tool":"doctoquiz","tool_name":"DoctoQuiz","criterion":"can-it-read-your-material","criterion_name":"Can It Read Your Material?","criterion_definition":"Whether the tool correctly extracts or ingests the source material before generating questions, across inputs like PDFs, slides, handwritten notes, and video.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"If the tool cannot correctly ingest or extract the study material, it cannot generate quizzes from it at all. (3 of 3 judges)","scenario":"handwritten-student-notes-on-sexual-reproduction-in-flowering-plants","scenario_name":"Handwritten student notes on sexual reproduction in flowering plants","group_tag":"sexual-reproduction-in-flowering-plants","scenario_description":"Scanned handwritten student notes covering the same biology chapter. It was used to test OCR accuracy and the usefulness of quiz generation when the source is informal handwriting rather than typed text.","modality":"pdf","input_text":null,"input_artifact_refs":[{"alt":null,"url":"https://d3epheqghktydj.cloudfront.net/generate-quizzes-and-practice-tests-from-input2-secondary-98543a951470.pdf","role":"input","filename":"input2_secondary.pdf"}],"stresses":["handwriting OCR","noisy scan interpretation","informal note structure","question generation quality from OCR-dependent input"],"verdict":"worked","score":null,"score_total":null,"note":"Can ingest scanned handwriting well enough to generate a full quiz output instead of stopping at extraction failure.","evidence_state":"verified","source":null,"artifacts":[{"url":"https://cdn.futuresmart.ai/public/aidemos/67a8bf5adb784d2b873f4deb23c78e0a.png?v=1","role":"output","alt":null}],"run_id":"de7b348e-4326-4fbf-87c1-b104750bc459","study_title":"Generate Quizzes and Practice Tests from Study Material Using AI","study_kind":"generation","research_task":"86ba51dce","tested_at":null,"completeness":"input-and-output","input":{"state":"files","text":null,"files":[{"url":"https://d3epheqghktydj.cloudfront.net/generate-quizzes-and-practice-tests-from-input2-secondary-98543a951470.pdf","filename":"input2_secondary.pdf","alt":"Handwritten student notes on sexual reproduction in flowering plants","role":"input"}],"modality":"pdf","stresses":["handwriting OCR","noisy scan interpretation","informal note structure","question generation quality from OCR-dependent input"]},"tool_page_slug":"doctoquiz","tool_url":"https://aidemos.com/tools/doctoquiz","permalink":"https://aidemos.com/evidence/dde36703-9bde-4a45-98fd-65364d85e81a","api_url":"https://ai.aidemos.com/v1/observations/dde36703-9bde-4a45-98fd-65364d85e81a"},"peers":[{"id":"8ec5a5e9-2aa6-42e4-a5ba-508b7ebcbb2d","tool":"edcafe-ai","tool_name":"Edcafe AI","verdict":"failed","score":null,"score_total":null,"note":"Native OCR/PDF ingestion can fail on scanned handwritten notes with the same 'No text could be extracted from the file' error, leaving the tool with no generated quiz.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/fc647d2ce2d94ea08526295b5c4d7c2b.png?v=1","evidence_url":"https://aidemos.com/evidence/8ec5a5e9-2aa6-42e4-a5ba-508b7ebcbb2d"},{"id":"e561a466-0b02-4d3d-8792-46507bc20687","tool":"knowt","tool_name":"Knowt","verdict":"worked","score":null,"score_total":null,"note":"The tool can OCR scanned handwritten notes well enough to generate a usable question set, including a correctly answered long-form item on double fertilisation.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/f43f812eb1a44467bbbebf666d4b33db.png?v=1","evidence_url":"https://aidemos.com/evidence/e561a466-0b02-4d3d-8792-46507bc20687"},{"id":"a708aa45-a485-40c3-b002-014741d9e9f9","tool":"pdf-to-quiz","tool_name":"PDF to Quiz","verdict":"worked","score":null,"score_total":null,"note":"It OCR-read the scanned handwritten notes well enough to produce a full quiz from them, and the review footage shows a 10-question set generated from that input.","artifact_count":2,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/3fad40db698c4cc18f6181c5612b67dc.png?v=1","evidence_url":"https://aidemos.com/evidence/a708aa45-a485-40c3-b002-014741d9e9f9"},{"id":"895bda1e-d395-4bd3-8cf7-7dcb8fb36f45","tool":"questionwell","tool_name":"QuestionWell","verdict":"worked","score":null,"score_total":null,"note":"Correctly ingests scanned handwritten notes and produces the same structured output depth as the typed PDF run, including application-level Discussion questions, MCQs with Bloom's/DOK tags, and extracted Vocabulary terms with definitions.","artifact_count":3,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/327c5bc97e2b4cd9833bec34dd564eb6.jpeg?v=1","evidence_url":"https://aidemos.com/evidence/895bda1e-d395-4bd3-8cf7-7dcb8fb36f45"},{"id":"f0900fdf-878e-468e-99c6-df4629384ba3","tool":"quizgecko","tool_name":"Quizgecko","verdict":"worked","score":null,"score_total":null,"note":"The tool processes scanned handwritten notes well enough to generate a full question set instead of collapsing into broken OCR fragments or partial extraction.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/f0900fdf-878e-468e-99c6-df4629384ba3"},{"id":"f12c7bf1-9ffd-4f6b-8cf9-b1b8ff5918a7","tool":"quizizz","tool_name":"Quizizz","verdict":"worked","score":null,"score_total":null,"note":"The scanned handwritten notes were OCR-processed well enough to generate a 30-question quiz from the same chapter, showing that informal handwriting could still be converted into usable study questions.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/f12c7bf1-9ffd-4f6b-8cf9-b1b8ff5918a7"},{"id":"a5cad74e-257d-4806-b1b0-d0aeabadf7e2","tool":"quizrise","tool_name":"QuizRise","verdict":"worked","score":null,"score_total":null,"note":"The scanned handwritten notes were OCRed well enough to generate a complete quiz output, showing that informal handwriting was successfully converted into usable study questions.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/999f7a43e6b3491795ccb67cdd689130.png?v=1","evidence_url":"https://aidemos.com/evidence/a5cad74e-257d-4806-b1b0-d0aeabadf7e2"},{"id":"0590a7d9-4e2b-4fe1-bec2-81c51aa4aa22","tool":"studyglen","tool_name":"Studyglen","verdict":"mixed","score":null,"score_total":null,"note":"The tool can process a scanned handwritten notes PDF and warns that OCR may take 2–5 minutes, but the resulting deck was much thinner than the typed run at 5 questions instead of 19.","artifact_count":4,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/85a1c8c551404dd3ba390d937499f09b.png?v=1","evidence_url":"https://aidemos.com/evidence/0590a7d9-4e2b-4fe1-bec2-81c51aa4aa22"},{"id":"2ac596e6-f472-4dab-b058-8233fdaf8b86","tool":"studyx-ai","tool_name":"StudyX AI","verdict":"worked","score":null,"score_total":null,"note":"Successfully OCRs scanned handwritten notes into a 20-question quiz; the generated questions cover chapter concepts like water for fertilization, the mature embryo sac, microgametogenesis, tapetum, polyembryony, and the filiform apparatus.","artifact_count":1,"thumbnail":"https://cdn.futuresmart.ai/public/aidemos/5a6461f32b9b479c815b8f50bebf45d0.mp4?v=1","evidence_url":"https://aidemos.com/evidence/2ac596e6-f472-4dab-b058-8233fdaf8b86"}],"other_criteria":[{"id":"daa5fdfa-36bf-4213-bc13-41df436b3823","criterion":"are-the-questions-actually-good","criterion_name":"Are the Questions Actually Good?","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The handwritten-notes run is slightly richer and uses fuller distractors, but it is still only marginally harder than the typed-PDF run and remains recall-heavy.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/daa5fdfa-36bf-4213-bc13-41df436b3823"}],"appears_in":[{"page_type":"ranking","slug":"quiz-generators","title":"Best AI Tools for Generating Quizzes and Practice Tests from Study Material","url":"https://aidemos.com/best/quiz-generators","binding":"run"},{"page_type":"tool","slug":"doctoquiz","title":null,"url":"https://aidemos.com/tools/doctoquiz","binding":"run"}],"same_scenario":[{"id":"8ec5a5e9-2aa6-42e4-a5ba-508b7ebcbb2d","tool":"edcafe-ai","tool_name":"Edcafe AI","verdict":"failed","score":null,"score_total":null,"note":"Native OCR/PDF ingestion can fail on scanned handwritten notes with the same 'No text could be extracted from the file' error, leaving the tool with no generated quiz."},{"id":"e561a466-0b02-4d3d-8792-46507bc20687","tool":"knowt","tool_name":"Knowt","verdict":"worked","score":null,"score_total":null,"note":"The tool can OCR scanned handwritten notes well enough to generate a usable question set, including a correctly answered long-form item on double fertilisation."},{"id":"a708aa45-a485-40c3-b002-014741d9e9f9","tool":"pdf-to-quiz","tool_name":"PDF to Quiz","verdict":"worked","score":null,"score_total":null,"note":"It OCR-read the scanned handwritten notes well enough to produce a full quiz from them, and the review footage shows a 10-question set generated from that input."},{"id":"895bda1e-d395-4bd3-8cf7-7dcb8fb36f45","tool":"questionwell","tool_name":"QuestionWell","verdict":"worked","score":null,"score_total":null,"note":"Correctly ingests scanned handwritten notes and produces the same structured output depth as the typed PDF run, including application-level Discussion questions, MCQs with Bloom's/DOK tags, and extracted Vocabulary terms with definitions."},{"id":"f0900fdf-878e-468e-99c6-df4629384ba3","tool":"quizgecko","tool_name":"Quizgecko","verdict":"worked","score":null,"score_total":null,"note":"The tool processes scanned handwritten notes well enough to generate a full question set instead of collapsing into broken OCR fragments or partial extraction."},{"id":"f12c7bf1-9ffd-4f6b-8cf9-b1b8ff5918a7","tool":"quizizz","tool_name":"Quizizz","verdict":"worked","score":null,"score_total":null,"note":"The scanned handwritten notes were OCR-processed well enough to generate a 30-question quiz from the same chapter, showing that informal handwriting could still be converted into usable study questions."},{"id":"a5cad74e-257d-4806-b1b0-d0aeabadf7e2","tool":"quizrise","tool_name":"QuizRise","verdict":"worked","score":null,"score_total":null,"note":"The scanned handwritten notes were OCRed well enough to generate a complete quiz output, showing that informal handwriting was successfully converted into usable study questions."},{"id":"0590a7d9-4e2b-4fe1-bec2-81c51aa4aa22","tool":"studyglen","tool_name":"Studyglen","verdict":"mixed","score":null,"score_total":null,"note":"The tool can process a scanned handwritten notes PDF and warns that OCR may take 2–5 minutes, but the resulting deck was much thinner than the typed run at 5 questions instead of 19."},{"id":"2ac596e6-f472-4dab-b058-8233fdaf8b86","tool":"studyx-ai","tool_name":"StudyX AI","verdict":"worked","score":null,"score_total":null,"note":"Successfully OCRs scanned handwritten notes into a 20-question quiz; the generated questions cover chapter concepts like water for fertilization, the mature embryo sac, microgametogenesis, tapetum, polyembryony, and the filiform apparatus."}]}