observertoday.com
robots.txt

Robots Exclusion Standard data for observertoday.com

Resource Scan

Scan Details

Site Domain observertoday.com
Base Domain observertoday.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-02T14:40:45+00:00
Next Scan 2024-11-16T14:40:45+00:00

Last Successful Scan

Scanned2024-10-18T11:25:13+00:00
URL https://observertoday.com/robots.txt
Redirect https://www.observertoday.com/robots.txt
Redirect Domain www.observertoday.com
Redirect Base observertoday.com
Domain IPs 54.156.113.43, 54.80.201.50
Redirect IPs 216.137.52.31, 216.137.52.57, 216.137.52.88, 216.137.52.98
Response IP 3.164.206.103
Found Yes
Hash 297bb9fa153de9e8505384dba25ead008e2300d100e507bd520fd5d4f890aef9
SimHash 1901c100ed92

Groups

*

Rule Path
Disallow /newslink/