{"observation":{"id":"9832d5d0-f0d2-49fc-b1a0-5b209215563c","tool":"spider","tool_name":"Spider","criterion":"schema-extraction-integrity","criterion_name":"Schema Extraction Integrity","criterion_definition":"How accurately the tool outputs the requested structured data with the correct fields and valid formatting.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Accurate fields and valid formatting are central to structured-data extraction quality. (3 of 3 judges)","scenario":"nike-air-force-1-07-size-options-extraction","scenario_name":"Nike Air Force 1 '07 size options extraction","group_tag":null,"scenario_description":"A Nike product page with client-side JavaScript hydration used to test whether a headless scraper waits for dynamic DOM content before extracting product details and all available shoe sizes.","modality":"mixed","input_text":"https://www.nike.com/t/air-force-1-07-mens-shoes-jBrhbr/CW2288-111 — Wait for the size selection options to fully render. Extract the product name, price, and a list of all available shoe sizes.","input_artifact_refs":[],"stresses":[],"verdict":"mixed","score":null,"score_total":null,"note":"It can still extract static metadata cleanly, such as structural description definitions and basic marketing attributes, even when the dynamic transactional section is missing.","evidence_state":"observed","source":"first-party","artifacts":[],"run_id":"06e1dbd6-5518-4af8-aa1a-735259a75b4f","study_title":"Scrape Web Pages Into Clean Markdown or Structured Data Using AI","study_kind":"backfill","research_task":"86b9jm3a3","tested_at":"2026-06-23T04:32:57.304000+00:00","completeness":"input-only","input":{"state":"text","text":"https://www.nike.com/t/air-force-1-07-mens-shoes-jBrhbr/CW2288-111 — Wait for the size selection options to fully render. Extract the product name, price, and a list of all available shoe sizes.","files":[],"modality":"mixed","stresses":[]},"tool_page_slug":"spider","tool_url":"https://aidemos.com/tools/spider","permalink":"https://aidemos.com/evidence/9832d5d0-f0d2-49fc-b1a0-5b209215563c","api_url":"https://ai.aidemos.com/v1/observations/9832d5d0-f0d2-49fc-b1a0-5b209215563c"},"peers":[{"id":"81fd1d9a-a98b-4d03-8089-b844f39cd611","tool":"jina-ai-reader","tool_name":"Jina AI Reader","verdict":"mixed","score":null,"score_total":null,"note":"Can still extract some static fields correctly on a dynamic product page, including the SEO header and price markers, but it corrupts the requested product-specific output by substituting broad site-directory text for the size data.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/81fd1d9a-a98b-4d03-8089-b844f39cd611"},{"id":"b903a087-1027-4526-92f2-daf9f93cd3b0","tool":"skyvern","tool_name":"Skyvern","verdict":"worked","score":null,"score_total":null,"note":"Outputs a structured size list with many men/women pairs, with the visible payload spanning at least M 6 / W 7.5 through M 14 / W 15.5.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skyvern-skyvern-extract-nike-af1-product-data.png","evidence_url":"https://aidemos.com/evidence/b903a087-1027-4526-92f2-daf9f93cd3b0"}],"other_criteria":[{"id":"9158d75f-e4b0-45ac-8a1f-7bfc1e64e2d2","criterion":"js-dom-hydration","criterion_name":"JS DOM Hydration","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"It captured the rendered product headline and basic metadata, including the Nike Air Force 1 '07 title, the Men's Shoes label, and the $115 price.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/9158d75f-e4b0-45ac-8a1f-7bfc1e64e2d2"},{"id":"f6d91057-4e09-49ff-9f3f-7517589be27e","criterion":"js-dom-hydration","criterion_name":"JS DOM Hydration","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"It failed to wait for client-side hydration of the size picker, leaving the size-selection area empty and returning zero available sizing attributes.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/f6d91057-4e09-49ff-9f3f-7517589be27e"},{"id":"b3fb32f1-4d48-4b61-89b4-4e42d4c5910e","criterion":"js-dom-hydration","criterion_name":"JS DOM Hydration","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Does not wait for client-side hydration long enough; it can capture the title and price but misses the size-selection UI entirely, leaving zero available sizing attributes.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/b3fb32f1-4d48-4b61-89b4-4e42d4c5910e"},{"id":"4c241c05-718a-4c32-acda-4ce23a4712cf","criterion":"output-quality","criterion_name":"Output Quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"Extracted the product title, category, and price cleanly, but the result remained incomplete because the dynamic size inventory was not captured.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/4c241c05-718a-4c32-acda-4ce23a4712cf"},{"id":"211edfb6-01b4-4807-9497-29cf281be794","criterion":"output-quality","criterion_name":"Output Quality","rank_role":"decisive","verdict":"struggled","score":null,"score_total":null,"note":"Preserved the product title and $115 price, but omitted the dynamic size-selection and inventory section, leaving the result incomplete.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/211edfb6-01b4-4807-9497-29cf281be794"}],"appears_in":[{"page_type":"ranking","slug":"ai-web-scraping-tools","title":"Best AI Tools to Scrape Web Pages Into Clean Markdown or Structured Data","url":"https://aidemos.com/best/ai-web-scraping-tools","binding":"run"}],"same_scenario":[{"id":"81fd1d9a-a98b-4d03-8089-b844f39cd611","tool":"jina-ai-reader","tool_name":"Jina AI Reader","verdict":"mixed","score":null,"score_total":null,"note":"Can still extract some static fields correctly on a dynamic product page, including the SEO header and price markers, but it corrupts the requested product-specific output by substituting broad site-directory text for the size data."},{"id":"b903a087-1027-4526-92f2-daf9f93cd3b0","tool":"skyvern","tool_name":"Skyvern","verdict":"worked","score":null,"score_total":null,"note":"Outputs a structured size list with many men/women pairs, with the visible payload spanning at least M 6 / W 7.5 through M 14 / W 15.5."}]}