phweb.net
robots.txt

Robots Exclusion Standard data for phweb.net

Resource Scan

Scan Details

Site Domain phweb.net
Base Domain phweb.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-28T19:13:29+00:00
Next Scan 2026-01-04T19:13:29+00:00

Last Successful Scan

Scanned2025-12-20T01:55:51+00:00
URL https://phweb.net/robots.txt
Domain IPs 2a02:4780:84:556:a819:8245:c72a:833c, 2a02:4780:84:7bbd:7ef3:f8eb:b03b:d14, 84.32.84.157, 84.32.84.96
Response IP 77.37.66.110
Found Yes
Hash 8278d639d59531cc19c9fc516d502f1057eea38ad92fbd995e7f21bc799c97e4
SimHash d830da328377

Groups

yandex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 2

twitterbot

Rule Path
Allow /