globe-group.com
robots.txt

Robots Exclusion Standard data for globe-group.com

Resource Scan

Scan Details

Site Domain globe-group.com
Base Domain globe-group.com
Scan Status Ok
Last Scan2024-05-18T21:55:49+00:00
Next Scan 2024-06-17T21:55:49+00:00

Last Scan

Scanned2024-05-18T21:55:49+00:00
URL https://globe-group.com/robots.txt
Redirect https://www.globe-groupe.com/robots.txt
Redirect Domain www.globe-groupe.com
Redirect Base globe-groupe.com
Domain IPs 80.247.235.145
Redirect IPs 80.247.235.145
Response IP 80.247.235.145
Found Yes
Hash a54045159c763641f6ac2bba84f1048dc5a09e87398d638a02f1116f56acc08f
SimHash 6a005c4e26f0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /license.txt
Disallow /wp-config.php
Disallow /wp-cron.php
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /?s=

Comments

  • Directories
  • Files
  • Paths (no clean URLs)
  • User-agent: *
  • Crawl-delay: 10