cruise-international.com
robots.txt

Robots Exclusion Standard data for cruise-international.com

Resource Scan

Scan Details

Site Domain cruise-international.com
Base Domain cruise-international.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-24T12:42:28+00:00
Next Scan 2024-06-22T12:42:28+00:00

Last Successful Scan

Scanned2023-08-28T09:46:17+00:00
URL http://cruise-international.com/robots.txt
Redirect https://cruiseandtravel.telegraph.co.uk/robots.txt
Redirect Domain cruiseandtravel.telegraph.co.uk
Redirect Base telegraph.co.uk
Domain IPs 185.156.67.53
Redirect IPs 23.211.140.98, 23.211.140.99
Response IP 42.99.140.187
Found Yes
Hash f44dc57af34562d24d357992e1add6c904a139651428428ad3197ceebe9bf4d5
SimHash 6904da008157

Groups

google

Rule Path
Disallow

yahoo

Rule Path
Disallow

msn

Rule Path
Disallow

bing

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /?s=*
Disallow /wp-admin/
Disallow /cmc_login/

Other Records

Field Value
sitemap https://cruiseandtravel.telegraph.co.uk/sitemap_index.xml