Settings: coopshop

Configuration

Schedule

Cadence and activation state for automated runs.

If Unscheduled is enabled, the scheduler clears the next run and ignores the interval until you schedule it again.

How often the scraper should be queued.

State: unscheduled

minutes

Turn schedule generation on or off.

Keep settings but stop dispatching runs.

Clear the next run entirely and reset to unscheduled state.

Execution

How each run is launched and bounded. Leave any field blank to inherit the platform default.

Verbosity of scraper logs. Set to DEBUG to see individual proxy validation results.

Effective: INFO

Response cache time-to-live. Requests whose URL matches a cached entry are served without hitting the network. Set to 0 to disable. Leave blank for platform default (43 200 s = 12 h).

Effective: 43200 (platform default)

seconds

Parallel workers for new runs.

Effective: 10 · scraper_default

Retry attempts before failing the run.

Effective: 5 · scraper_default

Per-request network timeout.

Effective: 20 · scraper_default

seconds

Delay inserted between outbound requests.

Effective: · platform default

seconds

Grace period before the worker is asked to stop.

Effective: 10800 · platform default

seconds

Hard wall-clock cap for the run.

Effective: 14400 · platform default

seconds

Stops runs that stop making progress.

Effective: · platform default

seconds

Limit detail page scrapes in incremental mode.

Effective: · platform default

pages

Worker Routing

Route this scraper to workers by policy.

Request Backend

HTTP transport and identity used for outbound requests.

HTTP transport backend. scrapling_fetcher=httpx, scrapling_stealth=TLS fingerprinting, scrapling_dynamic=Playwright.

Effective: requests

HTTP header profile (User-Agent, Accept, etc.). None (Random/Default) lets the backend choose. Useful for mimicking a consistent browser identity across requests.

Proxy Routing

Whether and how proxies are used and validated for outbound requests.

Enable proxy routing for all outbound requests.

Effective: enabled · system default

Number of consecutive failures before a proxy is evicted from the reservoir.

Effective: 3 · scraper_default

Transport used when validating proxies before admission. A heavier backend (e.g. stealth) is more representative but slower.

Effective: requests

Connect timeout for preflight checks. Leave blank for backend default (5 s for requests/fetcher, 10 s for stealth).

Effective: (default)

seconds

Times to retry a failed preflight before rejecting the proxy. 403 blocks are never retried regardless.

Effective: 0 · platform default

retries

If enabled, proxies returning a 4xx response (e.g. 403 Forbidden) during preflight are rejected immediately, without retrying.

Effective: Disabled

Override the default preflight test URL. Proxies are validated against this URL before admission. Useful for sites with strict geo-blocks or fingerprinting checks.

Effective: https://coopshop.hu/

Proxy Pools

Assign pools to this scraper and control pre-run refresh behaviour. Higher priority numbers are tried first.

Whether to revalidate assigned pools before starting. If stale skips revalidation when the pool was refreshed within pool_max_age_minutes.

Effective: never

Staleness threshold for If stale: pools not refreshed within this window are revalidated. Leave blank to use each pool's own default.

Effective: pool default

minutes

global

Reservoir

Controls how the active proxy reservoir is built, rotated, and maintained during a run.

How proxies are selected from the reservoir. round_robin cycles evenly; sticky reuses the same proxy until it fails; weighted biases toward historically successful proxies; random picks uniformly at random.

Effective: round_robin

Begin scraping once at least this many proxies have been admitted, even if the reservoir target is higher.

Effective: (target size)

Revalidate the live reservoir every N minutes during a run. Failing proxies are pruned and replaced. Leave blank or set to 0 to disable.

Effective: 60 · platform default

minutes

Bind the same proxy to a logical session for its lifetime. Enables fast fail-over when a proxy dies mid-session.

Scraper

Settings declared by this scraper's schema. Changes take effect on the next run.

Enable the proxy circuit breaker for this scraper. When disabled the circuit breaker is skipped entirely.

Effective: True (default)

Failure-rate fraction (0-1) at which the circuit breaker trips. Default 0.35 means 35% failure rate.

Effective: 0.35 (default)

Enable Scrapling's similarity-based adaptive extraction helper.

Effective: False (default)

Use the same proxy for the duration of a logical session.

Effective: False (default)

How long to keep a proxy bound to a sticky session.

Effective: 600 (default)

Scrape Hooks

Lifecycle-triggered actions (delivery, notifications, webhooks).

No hooks configured. Add one below.

Add New Hook

Cancel