4state.news
robots.txt

Robots Exclusion Standard data for 4state.news

Resource Scan

Scan Details

Site Domain 4state.news
Base Domain 4state.news
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-09T17:32:10+00:00
Next Scan 2024-06-08T17:32:10+00:00

Last Successful Scan

Scanned2024-02-10T16:08:15+00:00
URL https://4state.news/robots.txt
Redirect https://417.news/robots.txt
Redirect Domain 417.news
Redirect Base 417.news
Domain IPs 107.178.101.17
Redirect IPs 15.197.172.60
Response IP 15.197.172.60
Found Yes
Hash 4f5a7b4964258b6a971812eb88273a60a7f373bc583794f89867ba5c1c2dc8cf
SimHash 4c54d8146741

Groups

googlebot
bingbot
slurp
baiduspider

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /