humanevents.com
robots.txt

Robots Exclusion Standard data for humanevents.com

Resource Scan

Scan Details

Site Domain humanevents.com
Base Domain humanevents.com
Scan Status Ok
Last Scan2024-05-17T16:04:03+00:00
Next Scan 2024-05-24T16:04:03+00:00

Last Scan

Scanned2024-05-17T16:04:03+00:00
URL https://humanevents.com/robots.txt
Domain IPs 104.22.76.116, 104.22.77.116, 172.67.41.192, 2606:4700:10::6816:4c74, 2606:4700:10::6816:4d74, 2606:4700:10::ac43:29c0
Response IP 172.67.41.192
Found Yes
Hash ef3b881fbd783ce783d71bbfe875c76d6b03181aa4c39aa2fc806fc2fedcf3be
SimHash e800c804edd2

Groups

*

Rule Path
Disallow /categories/cat-*
Disallow /index.rss

Other Records

Field Value
sitemap http://humanevents.com/config/sitemap.xml