ErrLookup › unclecode/crawl4ai

unclecode/crawl4ai

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN · Python · 106 source files

Analyzed at 7e80152142 on 2026-08-14. 216 documented errors.

Code / MessageTypeSeverityTags
Error evaluating condition: ${{error.message}}
exception error http-500, crawl, server-error, memory
Container not found: ${config.container_selector}
exception warning http-400, deep-crawl, streaming, validation
Failed to evaluate wait condition: {str(e)}
exception warning http-400, config-validation, untrusted-config, hooks
Invalid hook type: {hook_type}
validation error http-500, streaming, crawler-pool, setup-error
Timeout after {timeout}ms waiting for selector '{css_selecto
exception warning artifacts, size-limit, configuration
Invalid CSS selector: '{css_selector}'
validation warning artifacts, quota, disk, configuration
Timeout after {timeout}ms waiting for selector '{wait_for}'
exception warning artifacts, not-found, validation, opaque-id
Invalid wait_for parameter: '{wait_for}'. It should be eithe
validation warning artifacts, not-found, symlink, security
Invalid config
exception info artifacts, not-found, ttl, expiry
Request failed
exception info artifacts, not-found, ephemeral-storage
Unknown strategy: {strategy_name}
validation critical memory, crawler-pool, load-shedding, resource-limits
Unsupported export format: {format}
validation warning ssrf-protection, egress, dns, url-blocked
File not found: {filepath}
exception warning ssrf-protection, egress, url-validation, url-blocked
Unsupported import format: {format}
validation warning ssrf-protection, egress, docker, blocked-hostname
Invalid parameter(s) for {klass.__name__}: {invalid}
validation warning ssrf-protection, egress, dns-rebinding, private-ip
field '{key}' is not permitted on {type_name} from an untrus
validation warning ssrf-protection, egress, scheme-validation, url-blocked
type '{type_name}' may not be constructed from an untrusted
validation warning ssrf-protection, egress, url-validation, relative-url
Invalid proxy string format: {proxy_str}
validation warning ssrf-protection, egress, redirect, blocked-hostname
enable_stealth cannot be used with browser_mode='builtin'. S
validation warning ssrf-protection, egress, dns-rebinding, ip-pinning
[NSTProxy] token and channel_id are required
validation error proxy, credentials, validation, nstproxy
[NSTProxy] Invalid protocol: {protocol}
validation error proxy, validation, nstproxy, configuration
[NSTProxy] API Error: {data.get('msg', 'Unknown error')}
exception error proxy, api, authentication, nstproxy, quota
[NSTProxy] Invalid API response — expected a non-empty list
exception error proxy, api, schema, nstproxy, retry
concurrency must be positive
validation error validation, configuration, link-preview, concurrency
timeout must be positive
validation error validation, configuration, link-preview, timeout
max_links must be positive
validation error validation, configuration, link-preview
score_threshold must be between 0.0 and 1.0
validation error validation, configuration, link-preview, threshold
At least one of include_internal or include_external must be
validation error validation, configuration, link-preview
extraction_strategy must be an instance of ExtractionStrateg
validation error validation, extraction, configuration, type-error
chunking_strategy must be an instance of ChunkingStrategy
validation error validation, chunking, configuration, type-error
markdown_generator must be an instance of MarkdownGeneration
validation error validation, markdown, serialization, configuration
link_preview_config must be LinkPreviewConfig object or dict
validation error validation, link-preview, configuration, type-error
virtual_scroll_config must be VirtualScrollConfig object or
validation error validation, virtual-scroll, configuration, type-error
C4A Script compilation error (script {i+1}): Line {error.l
validation error c4a-script, javascript, compilation, validation
C4A script compiler not available. Please ensure crawl4ai.sc
validation error installation, c4a-script, dependencies, import-error
Failed to compile C4A script: {str(e)}
validation error c4a-script, compilation, type-error, wrapping
Getting '{name}' is deprecated. {self._UNWANTED_PROPS[name]}
exception warning deprecation, migration, attribute-error, versioning
Setting '{name}' is deprecated. {self._UNWANTED_PROPS[name]}
exception warning deprecation, migration, attribute-error, configuration
LLMConfig.api_token may not reference an environment variabl
validation critical security, secrets, validation, llm-config, provenance
Local file not found: {local_file_path}
exception error local-file, file-url, filesystem, validation
URL must start with 'http://', 'https://', 'file://', or 'ra
validation error url-validation, scheme, input-validation
Failed on navigating ACS-GOTO: {str(e)}
exception error navigation, playwright, network, timeout
Body element is hidden: {visibility_info}
exception error visibility, spa, playwright, rendering
Wait condition failed: {str(e)}
exception error wait-for, selector, timeout, spa
Failed to extract HTML content: {str(e)}
exception error css-selector, extraction, playwright
Refusing to write download through symlink: {download_path}
validation error security, symlink, downloads, filesystem
Unsafe download filename rejected: {filename!r}
validation error security, path-traversal, downloads, symlink
Local file not found: {path}
exception error local-file, http-crawler, filesystem, validation
Unexpected status code for {url}
http error http-status, http-crawler, network
Request timed out: {str(e)}
exception error timeout, http-crawler, network
Connection failed: {str(e)}
exception error connection, dns, http-crawler, network
HTTP client error: {str(e)}
exception error http-client, aiohttp, network, http-crawler
HTTP request failed: {str(e)}
exception error http-crawler, hooks, unexpected-error, network
Unsupported URL scheme: {scheme}
validation error url-validation, scheme, http-crawler, input-validation
crawled_data table was not created
exception critical database, sqlite, initialization, filesystem
Database missing columns: {missing_columns}
exception error database, schema-migration, sqlite, upgrade
Memory usage exceeded threshold for {self.memory_wait_timeou
exception critical memory, dispatcher, resource-limits, async
Invalid source '{s}'. Valid sources are: {', '.join(valid_so
validation error validation, url-seeder, input-validation
Invalid URL, make sure the URL is a non-empty string
validation error validation, webcrawler, input-validation
Process HTML, Failed to extract content from the website: {u
exception error webcrawler, scraping, html-processing
Process HTML, Failed to extract content from the website: {u
exception error webcrawler, scraping, wrapper-exception
`domain_or_domains` must be a string or a list of strings.
validation error validation, url-seeder, input-validation
psutil not available, cannot clean old browser
exception error windows, browser-manager, dependencies, psutil
Failed to start browser: {e}
exception critical browser-manager, startup, playwright, environment
Browser type {self.browser_type} not supported
exception error browser-manager, validation, browser-type
CDP endpoint at {cdp_url} is not ready after startup
exception critical browser-manager, cdp, network, startup
Cannot create new browser contexts when using use_persistent
exception error browser-manager, persistent-context, configuration
Browser is not available. It may have been closed, crashed,
exception error browser-manager, lifecycle, webcrawler
Profile not found: {profile_path}
validation error browser-profiler, validation, filesystem
msvcrt module not available on this platform
exception warning browser-profiler, windows, platform-specific
termios/tty/select modules not available on this platform
exception warning browser-profiler, unix, platform-specific
stdin is not a terminal
exception warning browser-profiler, tty, interactive, environment
Cannot get terminal attributes: {e}
exception warning browser-profiler, tty, termios, environment
Profile not found: {profile_name_or_path}
validation error browser-profiler, validation, filesystem
Setting '{name}' is deprecated. {self._UNWANTED_PROPS[name]}
validation warning deprecation, content-filter, configuration, api-change
CrawlerRunConfig must be provided
validation error deep-crawling, validation, configuration
CrawlerRunConfig must be provided
validation error deep-crawling, config, api-usage
Priority queue empty
exception warning deep-crawling, priority-queue, frontier-exhausted
Authentication failed: {str(e)}
exception error docker-client, authentication, network
Cannot connect to server: {str(e)}
exception error docker-client, network, server-unreachable
Request timed out: {str(e)}
exception error docker-client, timeout, network
Failed to connect: {str(e)}
exception error docker-client, network, connection-reset
Server error {e.response.status_code}: {error_msg}
exception error docker-client, http-status, validation
Crawl failed: {result_data.get('msg', 'Unknown error')}
exception error docker-client, crawl-failure, server-error
Invalid source(s): {invalid}. Valid: {VALID_SOURCES}
validation error domain-mapper, validation, config
Setting '{name}' is deprecated. {self._UNWANTED_PROPS[name]}
validation error extraction, llm, deprecation, breaking-change
Either 'html' or 'url' must be provided
validation error extraction, schema-generation, validation
Setting '{name}' is deprecated. {message}
validation error extraction, schema-generation, deprecation, llm
Failed to fetch URL '{urls[0]}': {result.error_message}
exception error extraction, schema-generation, fetch-failure, network
HTTP {result.status_code} error for URL '{urls[0]}'
exception error extraction, schema-generation, http-status
Failed to fetch URL '{result.url}': {result.error_message}
exception error extraction, schema-generation, fetch-failure, batch
HTTP {result.status_code} error for URL '{result.url}'
exception error extraction, schema-generation, http-status, batch
LLM returned an empty response
exception error extraction, schema-generation, llm, empty-response
Failed to parse schema JSON: {str(e)}
exception error extraction, schema-generation, llm, json-parse
Failed to generate schema: {str(e)}
exception error extraction, schema-generation, llm, api-error
Failed to generate schema: no attempts succeeded
exception error extraction, schema-generation, llm, retry-exhausted
Regex for '{label}' won’t compile after fix: {e}
validation error
{k} is deprecated, {RegexExtractionStrategy._UNWANTED_PROPS[
validation error
LLM did not return valid JSON: {raw}
exception error
Invalid regex for '{lbl}': {e}
validation error
{cls.__name__} must implement 'run(self, url: str, **kwargs)
validation error
{cls.__name__}.run must be async
validation error
Script {script_name} not found in the folder {current_script
exception error
Invalid hook type: {hook_type}
validation error
Hook {hook_type} must return an instance of webdriver.Chrome
validation error
Failed to crawl {url}: {e.msg}
exception error
Database path is not set or is empty.
exception error
Unsupported extraction strategy
exception error
Unsupported chunking strategy
exception error
Failed to extract content from the website: {url}
exception error
The 'markdown_v2' attribute is deprecated and has been remov
exception error
The 'fit_markdown' attribute is deprecated and has been remo
exception error
The 'fit_html' attribute is deprecated and has been removed.
exception error
{self.__class__.__name__} object has no attribute '{attr}'
exception error
Timeout downloading PDF from {url}: {str(e)}
exception error network, timeout, pdf, download, runtime-error
Failed to download PDF from {url}: {str(e)}
exception error network, pdf, download, runtime-error, io
pypdf is required for PDF processing. Install with 'pip inst
exception error pdf, dependency, import-error, installation
Invalid scanline structure
exception warning pdf, image-extraction, data-corruption, decoding
Unsupported filter type: {filter_type}
exception warning pdf, image-extraction, decoding, data-corruption
Invalid proxy string format: {proxy_str}
exception error proxy, configuration, validation, parsing
LLM returned empty script.
exception error llm, c4a-script, compile, empty-response, runtime-error
Circular include {p}
exception error c4a-script, compile, circular-dependency, includes, validation
Unknown procedure {c.args[0]!r}
exception error c4a-script, compile, undefined-reference, procedures, validation
Unknown procedure {cmd.args[0]!r}
exception error c4a-script, compile, undefined-reference, internal-api
Unsupported number of browsers: {num_browsers}
exception error user-agent, validation, configuration, fingerprinting
Unsupported operating system
exception error platform, environment, system-info, os-error
Unsupported browser type: {browser_type}
exception error browser, playwright, validation, configuration
Invalid browser type. Must be one of: {', '.join(browsers.ke
exception error browser, playwright, validation, setup
Browser executable not found for type: {browser_type}
exception error browser, playwright, installation, environment, setup
Error sanitizing input: {str(e)}
exception error encoding, sanitization, input-validation, unicode
Invalid CSS selector , No elements found for CSS selector: {
exception error css-selector, html-parsing, beautifulsoup, crawl4ai
Invalid CSS selector: {css_selector}
exception error css-selector, error-masking, crawl4ai, chained-exception
Invalid CSS selector, No elements found for CSS selector: {c
exception error css-selector, excluded-tags, crawl4ai, beautifulsoup
This function must be run in Google Colab environment.
exception error environment, colab, virtual-display, crawl4ai
sentence-transformers is required for local embeddings. Inst
exception error dependency, embeddings, sentence-transformers, crawl4ai
Hook '{hook_name}' must be a callable function, got {type(ho
exception error hooks, validation, crawl4ai, docker-api
Cannot extract source code for hook '{hook_name}'. Make sure
exception error hooks, inspect, source-code, crawl4ai
Too many concurrent jobs for this caller
http warning http-429, rate-limit, quota, server, crawl4ai
Server busy, retry later
http warning http-503, backpressure, queue, retry-after, server
result.error_message
http error http-500, crawl-failure, error-message, server
str(e)
http error http-400, llm-provider, allowlist, validation
error_msg
http error http-400, llm-provider, validation, markdown
Task not found
http warning http-404, task-status, redis, ttl, polling
Rejected request: {e}
http error http-400, config-validation, sandbox, hooks, security
Crawl exceeded the time limit
http warning http-504, timeout, crawl-limit, asyncio
{"error": str(e), "server_memory_delta_mb": mem_delta_mb, "s
http error
Deep crawling with stream currently supports exactly one URL
http error
artifact exceeds {MAX_ARTIFACT_BYTES} bytes
exception error
artifact storage quota exceeded
exception error
Artifact not found
exception error
Admin scope required
http error
Memory at {mem_pct:.1f}%, refusing new browser
exception error
URL blocked
exception error
unsupported resource_types {bad}; allowed: {sorted(_ALLOWED_
validation error validation, pydantic, hooks, crawler
too many headers (max {_MAX_HEADERS})
validation error validation, pydantic, headers, hooks
invalid header name {name!r}
validation error validation, http-headers, hooks, security
control characters in value for header {name!r}
validation error validation, security, header-injection, hooks
too many hooks (max 10)
validation error validation, hooks, config, limits
unknown hook action {action!r}; allowed: {sorted(HOOK_REGIST
validation error validation, hooks, config, api-contract
invalid params for hook '{action}': {e}
validation error validation, pydantic, hooks, config
str(e)
http error http-400, webhook, validation, api
LLM provider not allowed
http error llm, authorization, config, api
e.response.text
http error mcp, http-proxy, passthrough, api
upstream request timed out
http error mcp, timeout, network, http-proxy
tool not found
http error mcp, http-404, tool-routing, api
resource not found
http error mcp, http-404, resources, api
Monitor not initialized
exception error initialization, runtime-error, fastapi, monitoring
str(e)
http error http-500, monitoring, initialization, fastapi
Invalid status: {status}. Must be one of: all, active, compl
http error http-400, validation, monitoring, api
Invalid limit: {limit}. Must be between 1 and 1000
http error http-400, validation, pagination, monitoring
Invalid metric: {metric}. Must be one of: memory, requests,
http warning fastapi, monitoring, validation, query-params
Invalid window: {window}. Only '5m' is currently supported
http warning fastapi, monitoring, validation, query-params
Cannot kill permanent browser. Use restart instead.
http warning fastapi, browser-pool, permissions, admin-actions
Browser with sig={req.sig} not found
http warning fastapi, browser-pool, not-found, admin-actions
URL must start with {schemes}
http warning fastapi, validation, security, ssrf, lfi, url
type must be 'CrawlerRunConfig' or 'BrowserConfig'
validation warning fastapi, validation, security, configuration, input-hardening
Token issuance is disabled: no api_token is configured on th
http error fastapi, authentication, configuration, security, token
Invalid or missing api_token
http error fastapi, authentication, security, token, credentials
Invalid email domain
http error auth, email, dns, validation
str(e)
http error config, validation, pydantic, http-400
Invalid URL format. Must start with http://, https://, or fo
http error url-validation, http-400, markdown
Crawl failed
http error crawl, network, http-500, playwright
Artifact too large
http error artifacts, http-413, storage, size-limit
Artifact storage quota exceeded
http error artifacts, http-507, quota, storage
Artifact not found
http error artifacts, http-404, storage
execute_js endpoint is disabled. Set CRAWL4AI_EXECUTE_JS_ENA
http warning execute-js, feature-flag, http-403, security, environment
Query parameter 'q' is required
http error llm, http-400, query-params, validation
At least one URL required
http error crawl, http-400, validation
Hooks are disabled. Set CRAWL4AI_HOOKS_ENABLED=true to enabl
http warning hooks, feature-flag, http-403, security, environment
Rejected config: {e}
http error config, security, provenance, http-400, validation
Crawl request failed: {results['results'][0]['error_message'
http error crawl4ai, server, http-500, batch-crawl
Context files not found
http warning crawl4ai, docker, http-404, packaging, llm-context
URL blocked (SSRF protection): {e}
http error crawl4ai, ssrf, http-400, security, network
URL must have a valid hostname
validation error crawl4ai, validation, webhook, url-parsing
URL blocked
validation error crawl4ai, ssrf, webhook, security, network
too many webhook headers
validation warning crawl4ai, webhook, validation, limits
invalid webhook header name: {name!r}
validation warning crawl4ai, webhook, validation, http-headers
webhook header not allowed: {name}
validation warning crawl4ai, webhook, validation, http-headers, security
invalid value for webhook header {name}
validation warning crawl4ai, webhook, validation, header-injection, limits
extraction_strategy must be an instance of ExtractionStrateg
validation error crawl4ai, config, validation, extraction
chunking_strategy must be an instance of ChunkingStrategy
validation error crawl4ai, config, validation, chunking
Getting '{name}' is deprecated. {self._UNWANTED_PROPS[name]}
exception error crawl4ai, deprecation, config, migration
Setting '{name}' is deprecated. {self._UNWANTED_PROPS[name]}
exception error crawl4ai, deprecation, config, migration
Invalid URL, make sure the URL is a non-empty string
validation error crawl4ai, validation, url, crawler
Process HTML, Failed to extract content from the website: {u
exception error crawl4ai, extraction, scraping, crawler
{e}
exception error crawl4ai, css-selector, validation, scraping
Process HTML, Failed to extract content from the website: {u
exception error crawl4ai, scraping, error-wrapping, crawler
Setting '{name}' is deprecated. {message}
exception warning crawl4ai, deprecation, schema-generation, llm-config
Failed to generate schema: {str(e)}
exception error crawl4ai, llm, exception-wrapping, schema-generation
The 'markdown_v2' attribute is deprecated and has been remov
exception warning crawl4ai, deprecation, markdown, crawl-result
The 'fit_markdown' attribute is deprecated and has been remo
exception warning crawl4ai, deprecation, content-filter, fit-markdown
The 'fit_html' attribute is deprecated and has been removed.
exception warning crawl4ai, deprecation, content-filter, fit-html
{self.__class__.__name__} object has no attribute '{attr}'
exception error crawl4ai, arun-many, empty-result, crawl-result-container
Failed to start browser: {e}
exception critical crawl4ai, browser-launch, subprocess, environment
Browser type {self.browser_type} not supported
exception error crawl4ai, browser-config, not-implemented, validation
CrawlerRunConfig must be provided
validation error crawl4ai, deep-crawl, config-required, validation