grabone.co.nz
robots.txt
Robots Exclusion Standard data for grabone.co.nz
Resource Scan
Scan Details
Site Domain | grabone.co.nz |
Base Domain | grabone.co.nz |
Scan Status | Ok |
Last Scan | 2024-09-23T08:05:34+00:00 |
Next Scan | 2024-09-30T08:05:34+00:00 |
Last Scan
Scanned | 2024-09-23T08:05:34+00:00 |
URL | https://grabone.co.nz/robots.txt |
Redirect | https://www.grabone.co.nz/robots.txt |
Redirect Domain | www.grabone.co.nz |
Redirect Base | grabone.co.nz |
Domain IPs | 3.165.82.102, 3.165.82.104, 3.165.82.113, 3.165.82.64 |
Redirect IPs | 104.22.6.139, 104.22.7.139, 172.67.23.193, 2606:4700:10::6816:68b, 2606:4700:10::6816:78b, 2606:4700:10::ac43:17c1 |
Response IP | 104.22.6.139 |
Found | Yes |
Hash | ab40b93ead6e02def1efded3610d9d31ae271fa259a04502dbb80c7459647a18 |
SimHash | 9051c4146109 |
Groups
*
Rule | Path |
---|---|
Disallow | /my-stuff |
Disallow | /buy |
Disallow | /gocount.php |
Disallow | /deal/*/facebook/share-privacy-filter |
Disallow | /deal/*/easy-buy-options |