hotfrog.co.uk
robots.txt
Robots Exclusion Standard data for hotfrog.co.uk
Resource Scan
Scan Details
| Site Domain | hotfrog.co.uk |
| Base Domain | hotfrog.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-22T06:15:25+00:00 |
| Next Scan | 2024-09-29T06:15:25+00:00 |
Last Scan
| Scanned | 2024-09-22T06:15:25+00:00 |
| URL | https://hotfrog.co.uk/robots.txt |
| Redirect | https://www.hotfrog.co.uk/robots.txt |
| Redirect Domain | www.hotfrog.co.uk |
| Redirect Base | hotfrog.co.uk |
| Domain IPs | 104.26.0.165, 104.26.1.165, 172.67.74.73, 2606:4700:20::681a:1a5, 2606:4700:20::681a:a5, 2606:4700:20::ac43:4a49 |
| Redirect IPs | 104.26.0.165, 104.26.1.165, 172.67.74.73, 2606:4700:20::681a:1a5, 2606:4700:20::681a:a5, 2606:4700:20::ac43:4a49 |
| Response IP | 104.26.0.165 |
| Found | Yes |
| Hash | 62178336fb6238c3ad6dfd2b671faea6a7e029b23af551a01e27981c188b91c8 |
| SimHash | 608d4b29f712 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /add |
| Disallow | /claim-listing/ |
| Disallow | /edit/ |
| Disallow | /login |
| Disallow | /message/ |
| Disallow | /paint/ |
| Disallow | /product/ |
| Disallow | /report/ |
| Disallow | /upgrade/ |
| Disallow | /review/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hotfrog.co.uk/sitemap-index.xml |