globe2.net
robots.txt

Robots Exclusion Standard data for globe2.net

Resource Scan

Scan Details

Site Domain globe2.net
Base Domain globe2.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-12T13:42:42+00:00
Next Scan 2025-09-10T13:42:42+00:00

Last Successful Scan

Scanned2023-05-24T05:01:04+00:00
URL https://globe2.net/robots.txt
Redirect https://www.globe2.net/robots.txt
Redirect Domain www.globe2.net
Redirect Base globe2.net
Domain IPs 104.21.93.80, 172.67.207.153, 2606:4700:3031::ac43:cf99, 2606:4700:3037::6815:5d50
Redirect IPs 104.21.93.80, 172.67.207.153, 2606:4700:3031::ac43:cf99, 2606:4700:3037::6815:5d50
Response IP 104.21.93.80
Found Yes
Hash 5a428f13a2d14c116146ee0e380cf4ff58a2aee94b5341ef3b64f6ad32a063d4
SimHash 6700c0524733

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.globe2.net/index.php/sitemap.xml