travelcentre.net
robots.txt

Robots Exclusion Standard data for travelcentre.net

Resource Scan

Scan Details

Site Domain travelcentre.net
Base Domain travelcentre.net
Scan Status Ok
Last Scan2024-09-15T03:08:03+00:00
Next Scan 2024-09-22T03:08:03+00:00

Last Scan

Scanned2024-09-15T03:08:03+00:00
URL https://travelcentre.net/robots.txt
Redirect https://www.travelcentre.net/robots.txt
Redirect Domain www.travelcentre.net
Redirect Base travelcentre.net
Domain IPs 185.3.235.185
Redirect IPs 185.3.235.185
Response IP 185.3.235.185
Found Yes
Hash 091004341429c3bd0002f9760925ae1a0077a3f257880f996877930b583fd852
SimHash 3a082908aeba

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-cron.php
Disallow /wp-content/uploads/
Disallow /wp-content/languages/
Disallow /wp-cron.php
Disallow /xmlrpc.php
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /clickout.php
Disallow */.well-known/*
Disallow *?cdr=*
Disallow /europareisen
Disallow /afrikareisen

Other Records

Field Value
sitemap https://www.travelcentre.net/sitemap_index.xml

Comments

  • Directories
  • Files
  • Paths (no clean URLs)