lifesite.net
robots.txt

Robots Exclusion Standard data for lifesite.net

Resource Scan

Scan Details

Site Domain lifesite.net
Base Domain lifesite.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-25T03:52:03+00:00
Next Scan 2025-10-23T03:52:03+00:00

Last Successful Scan

Scanned2024-06-07T16:59:27+00:00
URL https://lifesite.net/robots.txt
Redirect https://www.lifesitenews.com/robots.txt
Redirect Domain www.lifesitenews.com
Redirect Base lifesitenews.com
Domain IPs 104.21.62.224, 172.67.139.214, 2606:4700:3031::6815:3ee0, 2606:4700:3035::ac43:8bd6
Redirect IPs 104.22.40.170, 104.22.41.170, 172.67.5.62, 2606:4700:10::6816:28aa, 2606:4700:10::6816:29aa, 2606:4700:10::ac43:53e
Response IP 104.22.40.170
Found Yes
Hash 4be46b3343d290674075d1a5555d9fdc224728d26fb692c32debf020b690024e
SimHash 2118dc40c1f4

Groups

*

Rule Path
Disallow /ajax/*

Other Records

Field Value
crawl-delay 60