{"observation":{"id":"509adb45-829b-45f6-b216-f08ae6ac7454","tool":"spider","tool_name":"Spider","criterion":"proxy-evasion","criterion_name":"Proxy Evasion","criterion_definition":"How well the tool gets past anti-bot protections and modal or firewall barriers to reach the page content.","criterion_evidence_type":"transformation","criterion_rank_role":"decisive","criterion_rank_role_reason":"Bypassing anti-bot and modal barriers is often required to reach the page content at all, so it directly affects scraping success. (3 of 3 judges)","scenario":"glassdoor-software-engineer-jobs-behind-sign-in-modal","scenario_name":"Glassdoor software engineer jobs behind sign-in modal","group_tag":"web-scraping-benchmark","scenario_description":"A Glassdoor jobs listing page protected by Cloudflare and a sign-in/interstitial overlay, used to test proxy evasion, anti-bot handling, and the ability to dismiss blocking modal UI before extracting listings.","modality":"mixed","input_text":"https://www.glassdoor.com/Job/software-engineer-jobs-SRCH_KO0,17.htm — Dismiss any immediate sign-in or signup modal overlays that block the view. Once cleared, extract the top 5 job listings, including job title, company name, location, and the short summary snippet.","input_artifact_refs":[],"stresses":[],"verdict":"failed","score":null,"score_total":null,"note":"Native proxy handling fails against anti-bot protection, triggering a full 'Humans only' Cloudflare-style block page instead of the target listings.","evidence_state":"verified","source":"first-party","artifacts":[{"url":"https://d3epheqghktydj.cloudfront.net/spider-spider-playground-glassdoor-humans-only.png","role":"output","alt":"Spider Playground showing a Glassdoor access-block page"}],"run_id":"06e1dbd6-5518-4af8-aa1a-735259a75b4f","study_title":"Scrape Web Pages Into Clean Markdown or Structured Data Using AI","study_kind":"backfill","research_task":"86b9jm3a3","tested_at":"2026-06-23T04:32:57.304000+00:00","completeness":"input-and-output","input":{"state":"text","text":"https://www.glassdoor.com/Job/software-engineer-jobs-SRCH_KO0,17.htm — Dismiss any immediate sign-in or signup modal overlays that block the view. Once cleared, extract the top 5 job listings, including job title, company name, location, and the short summary snippet.","files":[],"modality":"mixed","stresses":[]},"tool_page_slug":"spider","tool_url":"https://aidemos.com/tools/spider","permalink":"https://aidemos.com/evidence/509adb45-829b-45f6-b216-f08ae6ac7454","api_url":"https://ai.aidemos.com/v1/observations/509adb45-829b-45f6-b216-f08ae6ac7454"},"peers":[{"id":"becc8618-b56d-4b69-9774-2f69f3610041","tool":"firecrawl","tool_name":"Firecrawl","verdict":"worked","score":null,"score_total":null,"note":"Bypasses Glassdoor's Cloudflare-style perimeter defenses and recovers the target job listing content, including active software-engineering listings, corporate profile names, salary estimates, and technical-skill arrays.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/becc8618-b56d-4b69-9774-2f69f3610041"},{"id":"cc9693d1-db28-4dc3-9db7-5bcf20dd9ebd","tool":"jina-ai-reader","tool_name":"Jina AI Reader","verdict":"struggled","score":null,"score_total":null,"note":"Although the anti-bot wall is bypassed, the recovered Glassdoor output is still a raw DOM dump with sign-in notices, framework noise, and header redirects interleaved, so the target listings require heavy downstream cleanup.","artifact_count":0,"thumbnail":null,"evidence_url":"https://aidemos.com/evidence/cc9693d1-db28-4dc3-9db7-5bcf20dd9ebd"},{"id":"3ffd638c-cf33-4a5f-8246-bdce17a568cf","tool":"skyvern","tool_name":"Skyvern","verdict":"worked","score":null,"score_total":null,"note":"The tool can bypass a standard interstitial sign-in/modal barrier and still recover the target content, outputting structured job listings with deterministic fields such as title, company, location, and summary.","artifact_count":1,"thumbnail":"https://d3epheqghktydj.cloudfront.net/skyvern-skyvern-job-listings-output-markdown.png","evidence_url":"https://aidemos.com/evidence/3ffd638c-cf33-4a5f-8246-bdce17a568cf"}],"other_criteria":[{"id":"f027509e-7bee-4fa6-8580-a72e8c2950e4","criterion":"noise-filtering","criterion_name":"Noise Filtering","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"The scraper fails to strip static boilerplate from cluttered pages: the markdown included the global header navigation, social-sharing URLs, cookie-choice notices, and user reviews instead of isolating only the core recipe content.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/f027509e-7bee-4fa6-8580-a72e8c2950e4"},{"id":"2dddc43a-aa71-4fd9-89a6-c195bdbcd6e6","criterion":"output-quality","criterion_name":"Output Quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The extractor preserves the main recipe content accurately, including the ingredients block and directions layout, but the returned markdown is highly unrefined and bloated with boilerplate text.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/2dddc43a-aa71-4fd9-89a6-c195bdbcd6e6"},{"id":"ec274907-80f4-4b17-8978-4513d4584e38","criterion":"output-quality","criterion_name":"Output Quality","rank_role":"decisive","verdict":"mixed","score":null,"score_total":null,"note":"The extractor can cleanly capture static structural text and basic marketing attributes, but it misses vital dynamic transactional nodes on hydrated pages.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/ec274907-80f4-4b17-8978-4513d4584e38"},{"id":"ec071df3-73be-44eb-b169-0f8eb530baee","criterion":"output-quality","criterion_name":"Output Quality","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Returned zero job payload; the output text consisted entirely of multilingual CAPTCHA strings and security warnings.","artifact_count":1,"evidence_url":"https://aidemos.com/evidence/ec071df3-73be-44eb-b169-0f8eb530baee"},{"id":"5d31e225-3519-47b9-97f4-420a31f39baa","criterion":"schema-extraction-integrity","criterion_name":"Schema Extraction Integrity","rank_role":"decisive","verdict":"worked","score":null,"score_total":null,"note":"It can preserve the main recipe content accurately, keeping the central ingredients block and recipe directions layout intact.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/5d31e225-3519-47b9-97f4-420a31f39baa"},{"id":"95ec5f9f-da1c-43e4-a0c4-32537ef704f0","criterion":"visual-spatial-awareness","criterion_name":"Visual Spatial Awareness","rank_role":"decisive","verdict":"failed","score":null,"score_total":null,"note":"Its structural-cleanup is weak on cluttered static pages: it leaves global navigation links, social-sharing URLs, cookie notices, and user reviews in the markdown instead of isolating the core page content.","artifact_count":0,"evidence_url":"https://aidemos.com/evidence/95ec5f9f-da1c-43e4-a0c4-32537ef704f0"}],"appears_in":[{"page_type":"ranking","slug":"ai-web-scraping-tools","title":"Best AI Tools to Scrape Web Pages Into Clean Markdown or Structured Data","url":"https://aidemos.com/best/ai-web-scraping-tools","binding":"run"}],"same_scenario":[{"id":"becc8618-b56d-4b69-9774-2f69f3610041","tool":"firecrawl","tool_name":"Firecrawl","verdict":"worked","score":null,"score_total":null,"note":"Bypasses Glassdoor's Cloudflare-style perimeter defenses and recovers the target job listing content, including active software-engineering listings, corporate profile names, salary estimates, and technical-skill arrays."},{"id":"cc9693d1-db28-4dc3-9db7-5bcf20dd9ebd","tool":"jina-ai-reader","tool_name":"Jina AI Reader","verdict":"struggled","score":null,"score_total":null,"note":"Although the anti-bot wall is bypassed, the recovered Glassdoor output is still a raw DOM dump with sign-in notices, framework noise, and header redirects interleaved, so the target listings require heavy downstream cleanup."},{"id":"3ffd638c-cf33-4a5f-8246-bdce17a568cf","tool":"skyvern","tool_name":"Skyvern","verdict":"worked","score":null,"score_total":null,"note":"The tool can bypass a standard interstitial sign-in/modal barrier and still recover the target content, outputting structured job listings with deterministic fields such as title, company, location, and summary."}]}