stories-en.historicalgenius.com
robots.txt

Robots Exclusion Standard data for stories-en.historicalgenius.com

Resource Scan

Scan Details

Site Domain stories-en.historicalgenius.com
Base Domain historicalgenius.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-04T10:01:58+00:00
Next Scan 2024-12-03T10:01:58+00:00

Last Successful Scan

Scanned2024-05-08T10:00:21+00:00
URL https://stories-en.historicalgenius.com/robots.txt
Domain IPs 104.22.38.136, 104.22.39.136, 172.67.42.18, 2606:4700:10::6816:2688, 2606:4700:10::6816:2788, 2606:4700:10::ac43:2a12
Response IP 104.22.39.136
Found Yes
Hash ec4d8d8673ec4e00a33c3f84fba8811824ed0f05a335b13c1965c172a5ac47c2
SimHash 01409b60c711

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /