element; using a selector valid for the rendered DOM but the passed html is pre-JavaScript markup; passing a selector targeting elements inside (body.select never sees them); passing malformed selectors like \"div[\" that BeautifulSoup cannot parse.","commonSituations":"Scraping SPAs where content is injected by JS after the static HTML was fetched; site redesigns that rename container classes; typos in configured selectors (e.g. missing dot for class); pages that return a captcha/consent wall instead of expected content so the selector matches nothing.","solutions":["Verify the selector against the exact HTML string being passed (open it or print soup.body.prettify()) — the DOM you select on is the static parsed body, not the rendered page.","Loosen the selector (\"article\" instead of \"div.article-content.prose\") or provide a fallback list of selectors tried in order.","For JS-rendered content, fetch via AsyncPlaywrightCrawlerStrategy / the main AsyncWebcrawler with js_code or wait_for, then pass the rendered HTML (or use CrawlerRunConfig.css_selector which handles this in the pipeline).","Validate the selector syntax first with soup.select on the soup object and catch InvalidCSSSelectorError to degrade gracefully."],"exampleFix":"// before\nresult = get_content_of_website(url, html, css_selector=\"main.post-content\")\n\n// after\nfrom crawl4ai.utils import InvalidCSSSelectorError\nfor sel in (\"main.post-content\", \"article\", \"body\"):\n try:\n result = get_content_of_website(url, html, css_selector=sel)\n break\n except InvalidCSSSelectorError:\n continue","handlingStrategy":"validation","validationCode":"from bs4 import BeautifulSoup\n\ndef selector_matches(html: str, css_selector: str) -> bool:\n soup = BeautifulSoup(html, \"html.parser\")\n body = soup.body or soup\n try:\n return bool(body.select(css_selector))\n except Exception:\n return False","typeGuard":null,"tryCatchPattern":"from crawl4ai.utils import InvalidCSSSelectorError\ntry:\n content = get_content_of_website(url, html, css_selector=sel)\nexcept InvalidCSSSelectorError as e:\n logger.warning(\"selector %r matched nothing: %s\", sel, e)\n content = get_content_of_website(url, html) # fallback: full body","preventionTips":["Validate selectors against the fetched static HTML before extraction","Keep a prioritized list of fallback selectors per site template","Log the saved HTML when a selector fails to catch site-redesign drift early"],"tags":["css-selector","html-parsing","beautifulsoup","crawl4ai"],"backgroundTag":null,"analyzedSha":"7e801521428ee12509994d39151006f64055ebe3","analyzedAt":"2026-08-14T20:46:20.673Z","schemaVersion":2},"datasetVersion":"2026-08-15T22:17:37.221Z"}