travelguide.co.nz
robots.txt

Robots Exclusion Standard data for travelguide.co.nz

Resource Scan

Scan Details

Site Domain travelguide.co.nz
Base Domain travelguide.co.nz
Scan Status Ok
Last Scan2024-05-08T14:16:44+00:00
Next Scan 2024-05-15T14:16:44+00:00

Last Scan

Scanned2024-05-08T14:16:44+00:00
URL https://travelguide.co.nz/robots.txt
Redirect https://www.travelguide.co.nz/robots.txt
Redirect Domain www.travelguide.co.nz
Redirect Base travelguide.co.nz
Domain IPs 104.26.8.177, 104.26.9.177, 172.67.71.65, 2606:4700:20::681a:8b1, 2606:4700:20::681a:9b1, 2606:4700:20::ac43:4741
Redirect IPs 104.26.8.177, 104.26.9.177, 172.67.71.65, 2606:4700:20::681a:8b1, 2606:4700:20::681a:9b1, 2606:4700:20::ac43:4741
Response IP 104.26.8.177
Found Yes
Hash e20eb744972bc434cce45d8fba0797c4e295a419c93cb8c872d32414c7c08e87
SimHash 455d0992d691

Groups

*

Rule Path
Disallow
Disallow /listing-category/
Disallow /search-listing
Disallow /city/
Disallow /listing/
Disallow /cdn-cgi/

mediapartners-google*

Rule Path
Allow /
Disallow /listing-category/*
Disallow /search-listing
Disallow /cdn-cgi/

googlebot-mobile

Rule Path
Allow /
Disallow /listing-category/*
Disallow /search-listing
Disallow /cdn-cgi/

adsbot-google

Rule Path
Allow /
Disallow /listing-category/*
Disallow /search-listing
Disallow /cdn-cgi/

googlebot

Rule Path
Allow /
Disallow /listing-category/*
Disallow /search-listing
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.travelguide.co.nz/sitemap.xml

Warnings

  • 10 invalid lines.