commentarymagazine.com
robots.txt

Robots Exclusion Standard data for commentarymagazine.com

Resource Scan

Scan Details

Site Domain commentarymagazine.com
Base Domain commentarymagazine.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-20T10:59:07+00:00
Next Scan 2024-06-19T10:59:07+00:00

Last Successful Scan

Scanned2024-02-03T07:38:42+00:00
URL https://commentarymagazine.com/robots.txt
Redirect https://www.commentary.org/robots.txt
Redirect Domain www.commentary.org
Redirect Base commentary.org
Domain IPs 104.26.4.61, 104.26.5.61, 172.67.71.171
Redirect IPs 104.22.64.173, 104.22.65.173, 172.67.41.83, 2606:4700:10::6816:40ad, 2606:4700:10::6816:41ad, 2606:4700:10::ac43:2953
Response IP 104.22.65.173
Found Yes
Hash eaeaa8d3511d1622227d89707d995b8b1f0902f5b86fdbe58882d1cef260d4d7
SimHash 4150c1524731

Groups

*

Rule Path
Allow /