travelbug.co.nz
robots.txt
Robots Exclusion Standard data for travelbug.co.nz
Resource Scan
Scan Details
Site Domain | travelbug.co.nz |
Base Domain | travelbug.co.nz |
Scan Status | Ok |
Last Scan | 2024-08-30T08:45:41+00:00 |
Next Scan | 2024-09-29T08:45:41+00:00 |
Last Scan
Scanned | 2024-08-30T08:45:41+00:00 |
URL | https://travelbug.co.nz/robots.txt |
Redirect | https://www.travelbug.co.nz/robots.txt |
Redirect Domain | www.travelbug.co.nz |
Redirect Base | travelbug.co.nz |
Domain IPs | 13.238.77.79 |
Redirect IPs | 2600:9000:2003:200:1e:a129:9500:93a1, 2600:9000:2003:2200:1e:a129:9500:93a1, 2600:9000:2003:3200:1e:a129:9500:93a1, 2600:9000:2003:4600:1e:a129:9500:93a1, 2600:9000:2003:7400:1e:a129:9500:93a1, 2600:9000:2003:9600:1e:a129:9500:93a1, 2600:9000:2003:cc00:1e:a129:9500:93a1, 2600:9000:2003:ec00:1e:a129:9500:93a1, 52.84.229.107, 52.84.229.12, 52.84.229.26, 52.84.229.46 |
Response IP | 52.84.229.107 |
Found | Yes |
Hash | 1292e55d3f8f0279be7362aededac87269b03a0d98692e2ba4d98f6768be07c4 |
SimHash | a21f15584be5 |
Groups
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /tmp/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.travelbug.co.nz/sitemap.xml |
Comments