←

Scraper: aldi

Run #48 success
Scraper
Source ⚙
aldi
Aldi Hungary | aldi-hu
Run #48
success
May 14, 2026, 11:09 a.m. → May 14, 2026, 11:14 a.m.
Run history
☰
12
Current and recent runs for this scraper
Items persisted
2,983
Avg fill 57% across recent runs
Cache
0 files
Size: 0.00 KB

Run Timeline

Metric samples captured during this run, aligned to scrape time.

Work Progress

Completed vs total work units tracked during the run. Persisted run samples.

Requests & Errors

Request, retry, cache, and error counts over the selected run. Persisted run samples.

Proxy Timeline

Current reservoir capacity, total leased proxies, and usage failures. Using Round Robin rotation strategy. Persisted run samples.

Proxy Preflight

Initial validation funnel (Target Size = Reservoir Capacity Goal). Using Round Robin rotation strategy. Persisted run samples.

Concurrency

Effective scraper thread usage vs Target baseline. Persisted run samples.

Extraction Funnel

Discovered items vs successfully persisted records and validation failures. Persisted run samples.

Response Time

Average and p95 request response time over the run. Persisted run samples.

Geographical Distribution

Total requests per country using active proxies.

Run Proxy Usage

Distribution and performance metrics for all proxies used during this run.

Total Proxies
16
16 used · 16 leased
Proxy Requests
115
5 ok · 0 retries
Failures
108
14 proxies saw failures
Suspicious
2
2 proxies flagged suspicious
Proxy Country ASN Registry Return Requests Success Failure Suspicious Retries Avg Latency
http://45.88.0.115:3128
 VG
208949
Hbing Limited
 active suspended 17 0 17 0 0 16,644.3 ms
http://38.75.82.221:999
 DO
273217
ACOLME TECH, SRL
 active suspended 16 0 16 0 0 13,071.6 ms
http://173.212.245.136:8888
vmi3216901.contaboserver.net
FR
51167
Contabo GmbH
 active suspended 13 0 13 0 0 10,304.2 ms
http://129.80.217.21:444
 US
31898
Oracle Corporation
 active suspended 12 1 11 0 0 1,583.1 ms
http://168.222.254.136:8888
 DE
198550
Node Host Limited
 active suspended 11 1 10 0 0 1,189.5 ms
http://212.224.88.212:443
 DE
214036
Ultahost, Inc.
 suspended suspended 11 0 11 0 0 1,974.5 ms
http://103.147.152.12:1080
 DE
50049
RedSwitches
 active suspended 10 0 10 0 0 1,754.7 ms
http://89.111.181.247:1080
c3971.colo.hc.ru
RU
39494
Jsc ru-center
 active available 10 1 9 0 0 10,177.9 ms
http://45.153.231.229:8080
vm3728321.example.com
RU
33993
UFO Hosting LLC
 suspended available 6 1 5 0 0 13,788.5 ms
http://84.47.150.125:1080
 RU
8641
LLC Nauka-Svyaz
 active available 3 1 2 0 0 1,874.3 ms
http://134.209.29.120:3128
 GB
14061
DigitalOcean, LLC
 active available 1 0 0 1 0 1,295.9 ms
http://138.68.60.8:3128
 US
14061
DigitalOcean, LLC
 active available 1 0 1 0 0 2,632.0 ms
http://139.59.1.14:8080
 IN
14061
DigitalOcean, LLC
 active available 1 0 1 0 0 2,370.2 ms
http://159.203.61.169:3128
 CA
14061
DigitalOcean, LLC
 active available 1 0 1 0 0 2,227.0 ms
http://198.199.86.11:3128
 US
14061
DigitalOcean, LLC
 active available 1 0 0 1 0 1,790.3 ms
http://209.97.150.167:3128
 US
14061
DigitalOcean, LLC
 active available 1 0 1 0 0 1,819.3 ms

Raw Logs

Polling updates append new output while the run is active.

← Back to overview [DEBUG] SUCCESS
aldi · Run #48
Cursor 42830 · [DEBUG] SUCCESS
Refresh
2026-05-14T09:09:51
stderr
Scraper start | job=48 task=ui-48 backend=scrapling_stealth proxy=True workers=10 retries=2
2026-05-14T09:09:51
stderr
Cloak active: False | humanize=False | geoip=False | fingerprint=-
2026-05-14T09:09:51
stderr
Proxy runtime gate: scraper=aldi_scraper use_proxy=True execution_context_use_proxy=True
2026-05-14T09:09:51
stderr
Proxy reservoir initialization: enabled=True pools=global target=20 validation_url=https://shop.aldi.hu/
2026-05-14T09:09:51
stderr
Refilling proxy reservoir: pools=global validation_url=https://shop.aldi.hu/ active=0 target=20 min_start=3
2026-05-14T09:09:51
stderr
[requests] Proxy http://134.209.29.120:3128 probing http://134.209.29.120:3128 for shop.aldi.hu
2026-05-14T09:09:51
stderr
[requests] Proxy http://209.97.150.167:3128 probing http://209.97.150.167:3128 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy http://139.59.1.14:8080 probing http://139.59.1.14:8080 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://210.89.42.212:443 probing http://210.89.42.212:443 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://89.208.248.187:8443 probing http://89.208.248.187:8443 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.236:10522 probing http://206.123.156.236:10522 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy http://159.203.61.169:3128 probing http://159.203.61.169:3128 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy http://198.199.86.11:3128 probing http://198.199.86.11:3128 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy http://138.68.60.8:3128 probing http://138.68.60.8:3128 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://210.89.42.118:443 probing http://210.89.42.118:443 for shop.aldi.hu
2026-05-14T09:09:52
stderr
Proxy admitted: http://45.88.0.115:3128 | UA: Mozilla/5.0 (Macintosh; Intel ...
2026-05-14T09:09:52
stderr
Proxy admitted: http://168.222.254.136:8888 | UA: Mozilla/5.0 (Macintosh; Intel ...
2026-05-14T09:09:52
stderr
Proxy admitted: http://45.153.231.229:8080 | UA: Mozilla/5.0 (X11; Linux x86_64...
2026-05-14T09:09:52
stderr
Proxy admitted: http://103.147.152.12:1080 | UA: Mozilla/5.0 (Macintosh; Intel ...
2026-05-14T09:09:52
stderr
Proxy admitted: http://212.224.88.212:443 | UA: Mozilla/5.0 (iPhone; CPU iPhon...
2026-05-14T09:09:52
stderr
Proxy admitted: http://173.212.245.136:8888 | UA: Mozilla/5.0 (Windows NT 10.0; ...
2026-05-14T09:09:52
stderr
Proxy admitted: http://84.47.150.125:1080 | UA: Mozilla/5.0 (Linux; Android 10...
2026-05-14T09:09:52
stderr
Proxy admitted: http://89.111.181.247:1080 | UA: Mozilla/5.0 (X11; Linux x86_64...
2026-05-14T09:09:52
stderr
Proxy admitted: http://129.80.217.21:444 | UA: Mozilla/5.0 (X11; Linux x86_64...
2026-05-14T09:09:52
stderr
[requests] Proxy http://134.209.29.120:3128 got target HTTP 403 for shop.aldi.hu via http://134.209.29.120:3128
2026-05-14T09:09:52
stderr
[requests] Proxy http://134.209.29.120:3128 blocked by target shop.aldi.hu (4xx) - skipping retries
2026-05-14T09:09:52
stderr
[requests] Proxy https://89.208.248.61:8443 probing http://89.208.248.61:8443 for shop.aldi.hu
2026-05-14T09:09:52
stderr
Proxy admitted: http://134.209.29.120:3128 | UA: Mozilla/5.0 (Windows NT 6.2; W...
2026-05-14T09:09:52
stderr
Proxy http://134.209.29.120:3128 admitted despite target rejection (proxy is reachable)
2026-05-14T09:09:52
stderr
[requests] Proxy https://210.89.42.212:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.221:23008 probing http://206.123.156.221:23008 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.221:23008 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.221', port=23008): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:52
stderr
[requests] Proxy https://210.89.42.118:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.225:18151 probing http://206.123.156.225:18151 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.225:7064 probing http://206.123.156.225:7064 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://89.208.248.187:8443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.234:6964 probing http://206.123.156.234:6964 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.234:6964 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.234', port=6964): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.236:7736 probing http://206.123.156.236:7736 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.225:7064 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.225', port=7064): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:52
stderr
[requests] Proxy https://154.26.182.140:3128 probing http://154.26.182.140:3128 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://89.208.248.61:8443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.210:8056 probing http://206.123.156.210:8056 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy http://198.199.86.11:3128 got target HTTP 403 for shop.aldi.hu via http://198.199.86.11:3128
2026-05-14T09:09:52
stderr
[requests] Proxy http://209.97.150.167:3128 got target HTTP 403 for shop.aldi.hu via http://209.97.150.167:3128
2026-05-14T09:09:52
stderr
[requests] Proxy http://198.199.86.11:3128 blocked by target shop.aldi.hu (4xx) - skipping retries
2026-05-14T09:09:52
stderr
[requests] Proxy http://209.97.150.167:3128 blocked by target shop.aldi.hu (4xx) - skipping retries
2026-05-14T09:09:52
stderr
[requests] Proxy https://5.178.98.214:443 probing http://5.178.98.214:443 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://138.199.35.205:9002 probing http://138.199.35.205:9002 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://154.26.182.140:3128 preflight error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.222:5882 probing http://206.123.156.222:5882 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy http://159.203.61.169:3128 got target HTTP 403 for shop.aldi.hu via http://159.203.61.169:3128
2026-05-14T09:09:52
stderr
[requests] Proxy http://159.203.61.169:3128 blocked by target shop.aldi.hu (4xx) - skipping retries
2026-05-14T09:09:52
stderr
[requests] Proxy socks5://206.123.156.211:7534 probing http://206.123.156.211:7534 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://5.178.98.214:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:52
stderr
[requests] Proxy https://128.199.19.32:443 probing http://128.199.19.32:443 for shop.aldi.hu
2026-05-14T09:09:52
stderr
[requests] Proxy https://138.199.35.205:9002 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:52
stderr
[requests] Proxy https://206.253.147.105:8090 probing http://206.253.147.105:8090 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy http://139.59.1.14:8080 got target HTTP 403 for shop.aldi.hu via http://139.59.1.14:8080
2026-05-14T09:09:53
stderr
[requests] Proxy http://139.59.1.14:8080 blocked by target shop.aldi.hu (4xx) - skipping retries
2026-05-14T09:09:53
stderr
[requests] Proxy https://93.180.217.254:443 probing http://93.180.217.254:443 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy http://138.68.60.8:3128 got target HTTP 403 for shop.aldi.hu via http://138.68.60.8:3128
2026-05-14T09:09:53
stderr
[requests] Proxy http://138.68.60.8:3128 blocked by target shop.aldi.hu (4xx) - skipping retries
2026-05-14T09:09:53
stderr
[requests] Proxy https://52.140.7.131:443 probing http://52.140.7.131:443 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.236:10522 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://45.8.98.142:30010 probing http://45.8.98.142:30010 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://206.253.147.105:8090 preflight error: ('Connection aborted.', BadStatusLine('\x15\x03\x03\x00\x02\x02P'))
2026-05-14T09:09:53
stderr
[requests] Proxy https://173.42.49.102:8090 probing http://173.42.49.102:8090 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://45.8.98.142:30010 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='45.8.98.142', port=30010): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy https://184.188.139.2:8090 probing http://184.188.139.2:8090 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://93.180.217.254:443 preflight error: ('Connection aborted.', BadStatusLine('\x15\x03\x03\x00\x02\x02\x16'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.221:23455 probing http://206.123.156.221:23455 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://128.199.19.32:443 preflight error: ('Connection aborted.', BadStatusLine('\x15\x03\x03\x00\x02\x02\x16'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.221:23455 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.221', port=23455): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.238:12585 probing http://206.123.156.238:12585 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.207:12011 probing http://206.123.156.207:12011 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.207:12011 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.207', port=12011): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.189:9803 probing http://206.123.156.189:9803 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.189:9803 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.189', port=9803): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://216.250.254.81:1080 probing http://216.250.254.81:1080 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://52.140.7.131:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.222:9408 probing http://206.123.156.222:9408 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.222:9408 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.222', port=9408): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy https://45.33.29.181:443 probing http://45.33.29.181:443 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://173.42.49.102:8090 preflight error: ('Connection aborted.', BadStatusLine('\x15\x03\x03\x00\x02\x02P'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.228:7130 probing http://206.123.156.228:7130 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://184.188.139.2:8090 preflight error: ('Connection aborted.', BadStatusLine('\x15\x03\x03\x00\x02\x02P'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.227:13346 probing http://206.123.156.227:13346 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.228:7130 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.228', port=7130): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy http://38.75.82.221:999 probing http://38.75.82.221:999 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://216.250.254.81:1080 preflight error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.187:8082 probing http://206.123.156.187:8082 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://45.33.29.181:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:53
stderr
[requests] Proxy https://35.89.254.112:443 probing http://35.89.254.112:443 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.225:18151 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.225:5919 probing http://206.123.156.225:5919 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.225:5919 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.225', port=5919): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:53
stderr
[requests] Proxy socks5://206.123.156.204:7707 probing http://206.123.156.204:7707 for shop.aldi.hu
2026-05-14T09:09:53
stderr
[requests] Proxy https://35.89.254.112:443 preflight error: ('Connection aborted.', BadStatusLine('\x15\x03\x03\x00\x02\x02\x16'))
2026-05-14T09:09:54
stderr
[requests] Proxy https://103.1.100.17:443 probing http://103.1.100.17:443 for shop.aldi.hu
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://206.123.156.238:12585 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.238', port=12585): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://195.19.50.79:1080 probing http://195.19.50.79:1080 for shop.aldi.hu
2026-05-14T09:09:54
stderr
[requests] Proxy https://103.1.100.17:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://206.123.156.225:5691 probing http://206.123.156.225:5691 for shop.aldi.hu
2026-05-14T09:09:54
stderr
[requests] Proxy http://38.75.82.221:999 passed preflight for shop.aldi.hu via http://38.75.82.221:999 (status=200)
2026-05-14T09:09:54
stderr
[requests] Proxy http://38.75.82.221:999 passed preflight for shop.aldi.hu (attempt 1)
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://206.123.156.187:8945 probing http://206.123.156.187:8945 for shop.aldi.hu
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://206.123.156.187:8945 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', NewConnectionError("HTTPSConnection(host='206.123.156.187', port=8945): Failed to establish a new connection: [Errno 111] Connection refused")))
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://206.123.156.236:7204 probing http://206.123.156.236:7204 for shop.aldi.hu
2026-05-14T09:09:54
stderr
[requests] Proxy socks5://206.123.156.204:7707 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:54
stderr
[requests] Proxy http://217.77.102.18:3128 probing http://217.77.102.18:3128 for shop.aldi.hu
2026-05-14T09:09:55
stderr
[requests] Proxy socks5://206.123.156.227:13346 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:55
stderr
[requests] Proxy https://34.93.103.38:443 probing http://34.93.103.38:443 for shop.aldi.hu
2026-05-14T09:09:55
stderr
[requests] Proxy https://34.93.103.38:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:55
stderr
[requests] Proxy https://34.93.13.41:443 probing http://34.93.13.41:443 for shop.aldi.hu
2026-05-14T09:09:56
stderr
[requests] Proxy https://34.93.13.41:443 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:56
stderr
[requests] Proxy socks5://206.123.156.210:8056 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:56
stderr
[requests] Proxy socks5://206.123.156.211:7534 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:56
stderr
[requests] Proxy socks5://195.19.50.79:1080 preflight error: ('Connection aborted.', BadStatusLine('\x05ÿ'))
2026-05-14T09:09:57
stderr
[requests] Proxy socks5://206.123.156.187:8082 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:57
stderr
[requests] Proxy socks5://206.123.156.222:5882 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', ConnectTimeoutError(<HTTPSConnection(host='206.123.156.222', port=5882) at 0x7fbc405922a0>, 'Connection to 206.123.156.222 timed out. (connect timeout=5)')))
2026-05-14T09:09:58
stderr
[requests] Proxy socks5://206.123.156.225:5691 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:09:59
stderr
[requests] Proxy socks5://206.123.156.236:7204 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Max retries exceeded with url: / (Caused by ProxyError('Unable to connect to proxy', ConnectTimeoutError(<HTTPSConnection(host='206.123.156.236', port=7204) at 0x7fbc402a23f0>, 'Connection to 206.123.156.236 timed out. (connect timeout=5)')))
2026-05-14T09:09:59
stderr
[requests] Proxy socks5://206.123.156.236:7736 preflight error: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
2026-05-14T09:10:00
stderr
[requests] Proxy http://217.77.102.18:3128 preflight error: HTTPSConnectionPool(host='shop.aldi.hu', port=443): Read timed out. (read timeout=5)
2026-05-14T09:10:10
stderr
Proxy admitted: http://198.199.86.11:3128 | UA: Mozilla/5.0 (Linux; U; Android...
2026-05-14T09:10:10
stderr
Proxy http://198.199.86.11:3128 admitted despite target rejection (proxy is reachable)
2026-05-14T09:10:10
stderr
Proxy admitted: http://209.97.150.167:3128 | UA: Mozilla/5.0 (X11; CrOS x86_64 ...
2026-05-14T09:10:10
stderr
Proxy http://209.97.150.167:3128 admitted despite target rejection (proxy is reachable)
2026-05-14T09:10:10
stderr
Preflight Status [20/60]: 9 passed, 3 blocked (4xx), 8 failed
2026-05-14T09:10:17
stderr
Proxy admitted: http://159.203.61.169:3128 | UA: Mozilla/5.0 (X11; Linux x86_64...
2026-05-14T09:10:17
stderr
Proxy http://159.203.61.169:3128 admitted despite target rejection (proxy is reachable)
2026-05-14T09:10:17
stderr
Proxy admitted: http://139.59.1.14:8080 | UA: Mozilla/5.0 (Linux; Android 15...
2026-05-14T09:10:17
stderr
Proxy http://139.59.1.14:8080 admitted despite target rejection (proxy is reachable)
2026-05-14T09:10:17
stderr
Proxy admitted: http://138.68.60.8:3128 | UA: Mozilla/5.0 (Android 10; Mobil...
2026-05-14T09:10:17
stderr
Proxy http://138.68.60.8:3128 admitted despite target rejection (proxy is reachable)
2026-05-14T09:10:20
stderr
Preflight Status [40/60]: 9 passed, 6 blocked (4xx), 25 failed
2026-05-14T09:10:21
stderr
Proxy admitted: http://38.75.82.221:999 | UA: Mozilla/5.0 (Windows NT 10.0; ...
2026-05-14T09:10:21
stderr
Preflight Status [60/60]: 10 passed, 6 blocked (4xx), 44 failed
2026-05-14T09:10:23
stderr
Proxy reservoir ready with 16 proxies (+0): http://45.88.0.115:3128, http://168.222.254.136:8888, http://45.153.231.229:8080, http://103.147.152.12:1080, http://212.224.88.212:443
2026-05-14T09:10:23
stderr
Reservoir revalidation thread started: interval=60m validation_url=https://shop.aldi.hu/
2026-05-14T09:10:23
stderr
Starting Aldi crawl
2026-05-14T09:10:23
stderr
Transport: 16 proxies (0 disabled) | Cache TTL: 43200 | Proxies enabled: True
2026-05-14T09:10:23
stderr
Proxy runtime state: db_runtime_use_proxy=True | reservoir_initialized=True
2026-05-14T09:10:23
stderr
Proxy config: pools=global | reservoir_target=20 | validation_url=https://shop.aldi.hu/
2026-05-14T09:10:23
stderr
Proxy sample: active=http://45.88.0.115:3128, http://168.222.254.136:8888, http://45.153.231.229:8080, http://103.147.152.12:1080, http://212.224.88.212:443 | disabled=—
2026-05-14T09:10:23
stderr
Launching browser to extract JWT token...
2026-05-14T09:10:23
stderr
Selected Playwright proxy: http://45.88.0.115:3128
2026-05-14T09:10:23
stderr
Launching Playwright browser: headless=True proxy=http://45.88.0.115:3128 reservoir_initialized=True
2026-05-14T09:10:32
stderr
Error during Playwright token extraction: Page.goto: net::ERR_TIMED_OUT at https://shop.aldi.hu/kezdooldal
2026-05-14T09:10:32
stderr
Call log:
2026-05-14T09:10:32
stderr
- navigating to "https://shop.aldi.hu/kezdooldal", waiting until "domcontentloaded"
2026-05-14T09:10:32
stderr
2026-05-14T09:10:32
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/category/GetFullCategoryList?providerCode=ALDI&isOwnWebshop=true | Proxy: http://168.222.254.136:8888 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[2026-05-14 11:10:34] INFO: Fetched (200) <GET https://shopservice.roksh.com/category/GetFullCategoryList?providerCode=ALDI&isOwnWebshop=true> (referer: https://www.google.com/)
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://45.153.231.229:8080 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://103.147.152.12:1080 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://212.224.88.212:443 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://173.212.245.136:8888 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://84.47.150.125:1080 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://89.111.181.247:1080 | [pool: 16/20]
2026-05-14T09:10:34
stderr
[scrapling_stealth] Scraping: https://shopservice.roksh.com/productlist/additionalCategoryProductList | Proxy: http://129.80.217.21:444 | [pool: 16/20]
2026-05-14T09:10:34
stderr
Aldi categories failed: connection failed: connection to server at "10.0.1.203", port 5432 failed: FATAL: sorry, too many clients already
2026-05-14T09:10:34
stderr
Traceback (most recent call last):
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 279, in ensure_connection
2026-05-14T09:10:34
stderr
self.connect()
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 256, in connect
2026-05-14T09:10:34
stderr
self.connection = self.get_new_connection(conn_params)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/postgresql/base.py", line 333, in get_new_connection
2026-05-14T09:10:34
stderr
connection = self.Database.connect(**conn_params)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/psycopg/connection.py", line 122, in connect
2026-05-14T09:10:34
stderr
raise last_ex.with_traceback(None)
2026-05-14T09:10:34
stderr
psycopg.OperationalError: connection failed: connection to server at "10.0.1.203", port 5432 failed: FATAL: sorry, too many clients already
2026-05-14T09:10:34
stderr
2026-05-14T09:10:34
stderr
The above exception was the direct cause of the following exception:
2026-05-14T09:10:34
stderr
2026-05-14T09:10:34
stderr
Traceback (most recent call last):
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/logging/__init__.py", line 1163, in emit
2026-05-14T09:10:34
stderr
stream.write(msg + self.terminator)
2026-05-14T09:10:34
stderr
File "/app/catalog/run_logs.py", line 235, in write
2026-05-14T09:10:34
stderr
append_scraper_run_log(self.state.scrape_job_id, self.state.scraper_name, line, stream=self.state.stream_name)
2026-05-14T09:10:34
stderr
File "/app/catalog/run_logs.py", line 65, in append_scraper_run_log
2026-05-14T09:10:34
stderr
run = ScraperRun.objects.get(scrape_job_id=scrape_job_id)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/models/manager.py", line 87, in manager_method
2026-05-14T09:10:34
stderr
return getattr(self.get_queryset(), name)(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/models/query.py", line 635, in get
2026-05-14T09:10:34
stderr
num = len(clone)
2026-05-14T09:10:34
stderr
^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/models/query.py", line 372, in __len__
2026-05-14T09:10:34
stderr
self._fetch_all()
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/models/query.py", line 2000, in _fetch_all
2026-05-14T09:10:34
stderr
self._result_cache = list(self._iterable_class(self))
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/models/query.py", line 95, in __iter__
2026-05-14T09:10:34
stderr
results = compiler.execute_sql(
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/models/sql/compiler.py", line 1622, in execute_sql
2026-05-14T09:10:34
stderr
cursor = self.connection.cursor()
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 320, in cursor
2026-05-14T09:10:34
stderr
return self._cursor()
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 296, in _cursor
2026-05-14T09:10:34
stderr
self.ensure_connection()
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 278, in ensure_connection
2026-05-14T09:10:34
stderr
with self.wrap_database_errors:
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/utils.py", line 94, in __exit__
2026-05-14T09:10:34
stderr
raise dj_exc_value.with_traceback(traceback) from exc_value
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 279, in ensure_connection
2026-05-14T09:10:34
stderr
self.connect()
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 256, in connect
2026-05-14T09:10:34
stderr
self.connection = self.get_new_connection(conn_params)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/postgresql/base.py", line 333, in get_new_connection
2026-05-14T09:10:34
stderr
connection = self.Database.connect(**conn_params)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/psycopg/connection.py", line 122, in connect
2026-05-14T09:10:34
stderr
raise last_ex.with_traceback(None)
2026-05-14T09:10:34
stderr
django.db.utils.OperationalError: connection failed: connection to server at "10.0.1.203", port 5432 failed: FATAL: sorry, too many clients already
2026-05-14T09:10:34
stderr
2026-05-14T09:10:34
stderr
During handling of the above exception, another exception occurred:
2026-05-14T09:10:34
stderr
2026-05-14T09:10:34
stderr
Traceback (most recent call last):
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 279, in ensure_connection
2026-05-14T09:10:34
stderr
self.connect()
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/base/base.py", line 256, in connect
2026-05-14T09:10:34
stderr
self.connection = self.get_new_connection(conn_params)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/utils/asyncio.py", line 26, in inner
2026-05-14T09:10:34
stderr
return func(*args, **kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/django/db/backends/postgresql/base.py", line 333, in get_new_connection
2026-05-14T09:10:34
stderr
connection = self.Database.connect(**conn_params)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/.venv/lib/python3.12/site-packages/psycopg/connection.py", line 122, in connect
2026-05-14T09:10:34
stderr
raise last_ex.with_traceback(None)
2026-05-14T09:10:34
stderr
psycopg.OperationalError: connection failed: connection to server at "10.0.1.203", port 5432 failed: FATAL: sorry, too many clients already
2026-05-14T09:10:34
stderr
2026-05-14T09:10:34
stderr
The above exception was the direct cause of the following exception:
2026-05-14T09:10:34
stderr
2026-05-14T09:10:34
stderr
Traceback (most recent call last):
2026-05-14T09:10:34
stderr
File "/app/scrapers/base_scraper.py", line 2555, in future_result_or_default
2026-05-14T09:10:34
stderr
return future.result()
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 449, in result
2026-05-14T09:10:34
stderr
return self.__get_result()
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
2026-05-14T09:10:34
stderr
raise self._exception
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 59, in run
2026-05-14T09:10:34
stderr
result = self.fn(*self.args, **self.kwargs)
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/scrapers/platform/aldi_scraper.py", line 188, in fetch_category_worker
2026-05-14T09:10:34
stderr
data = self.request_json(
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/scrapers/platform/aldi_scraper.py", line 90, in request_json
2026-05-14T09:10:34
stderr
return self.fetch_json_via_backend(
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/scrapers/base_scraper.py", line 2069, in fetch_json_via_backend
2026-05-14T09:10:34
stderr
resp = self.fetch_response_via_backend(
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/scrapers/base_scraper.py", line 2023, in fetch_response_via_backend
2026-05-14T09:10:34
stderr
resp = self.fetch_scrapling(
2026-05-14T09:10:34
stderr
^^^^^^^^^^^^^^^^^^^^^
2026-05-14T09:10:34
stderr
File "/app/scrapers/base_scraper.py", line 2400, in fetch_scrapling
2026-05-14T09:10:34
stderr
logger.info(
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/logging/__init__.py", line 1539, in info
2026-05-14T09:10:34
stderr
self._log(INFO, msg, args, **kwargs)
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/logging/__init__.py", line 1684, in _log
2026-05-14T09:10:34
stderr
self.handle(record)
2026-05-14T09:10:34
stderr
File "/usr/local/lib/python3.12/logging/__init__.py", line 1700, in handle
2026-05-14T09:10:35
stderr
self.callHandlers(record)
2026-05-14T09:10:35
stderr
File "/usr/local/lib/python3.12/logging/__init__.py", line 1762, in callHandlers
2026-05-14T09:10:35
stderr
hdlr.handle(record)

Sample Output

A small preview of records persisted by the selected run.

0 no persisted output
No persisted records are available for this run yet.