classifiedstahoe.com
robots.txt
Robots Exclusion Standard data for classifiedstahoe.com
Resource Scan
Scan Details
| Site Domain | classifiedstahoe.com |
| Base Domain | classifiedstahoe.com |
| Scan Status | Ok |
| Last Scan | 2024-09-15T20:28:26+00:00 |
| Next Scan | 2024-10-15T20:28:26+00:00 |
Last Scan
| Scanned | 2024-09-15T20:28:26+00:00 |
| URL | https://classifiedstahoe.com/robots.txt |
| Redirect | https://www.classifiedstahoe.com/robots.txt |
| Redirect Domain | www.classifiedstahoe.com |
| Redirect Base | classifiedstahoe.com |
| Domain IPs | 54.203.217.174 |
| Redirect IPs | 34.224.76.152, 52.54.211.216 |
| Response IP | 52.54.211.216 |
| Found | Yes |
| Hash | 1b8c352b46e98269f873d15f655c523c7041aef5f4a93b158387200661f8e28f |
| SimHash | 8a1e4d172981 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tahoe/login/ |
| Disallow | /tahoe/registration/ |
| Disallow | /tahoe/search/ |
| Disallow | /tahoe/account/ |
| Disallow | /tahoe/basket/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.classifiedstahoe.com/tahoe/sitemap.xml |
Comments