techpage.pl
robots.txt

Robots Exclusion Standard data for techpage.pl

Resource Scan

Scan Details

Site Domain techpage.pl
Base Domain techpage.pl
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-04-07T07:21:04+00:00
Next Scan 2025-06-06T07:21:04+00:00

Last Successful Scan

Scanned2025-02-07T07:19:13+00:00
URL https://techpage.pl/robots.txt
Domain IPs 194.181.228.45
Response IP 194.181.228.45
Found Yes
Hash 6256950883055275daa785760d80e91d45d403cfccb056ad410ec5a06c2465a6
SimHash 4000db124711

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow