hotfrog.co.nz
robots.txt
Robots Exclusion Standard data for hotfrog.co.nz
Resource Scan
Scan Details
Site Domain | hotfrog.co.nz |
Base Domain | hotfrog.co.nz |
Scan Status | Ok |
Last Scan | 2024-09-22T10:52:44+00:00 |
Next Scan | 2024-09-29T10:52:44+00:00 |
Last Scan
Scanned | 2024-09-22T10:52:44+00:00 |
URL | https://hotfrog.co.nz/robots.txt |
Redirect | https://www.hotfrog.co.nz/robots.txt |
Redirect Domain | www.hotfrog.co.nz |
Redirect Base | hotfrog.co.nz |
Domain IPs | 104.26.6.216, 104.26.7.216, 172.67.75.192, 2606:4700:20::681a:6d8, 2606:4700:20::681a:7d8, 2606:4700:20::ac43:4bc0 |
Redirect IPs | 104.26.6.216, 104.26.7.216, 172.67.75.192, 2606:4700:20::681a:6d8, 2606:4700:20::681a:7d8, 2606:4700:20::ac43:4bc0 |
Response IP | 172.67.75.192 |
Found | Yes |
Hash | 51b118e4e800697b6dabbfdd250db9f1131b3ba9e7554fcb9c3ebf23087f12e3 |
SimHash | 6a8d6921d792 |
Groups
*
Rule | Path |
---|---|
Disallow | /add |
Disallow | /claim-listing/ |
Disallow | /edit/ |
Disallow | /login |
Disallow | /message/ |
Disallow | /paint/ |
Disallow | /product/ |
Disallow | /report/ |
Disallow | /upgrade/ |
Disallow | /review/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.hotfrog.co.nz/sitemap-index.xml |