hodinkee.com
robots.txt
Robots Exclusion Standard data for hodinkee.com
Resource Scan
Scan Details
| Site Domain | hodinkee.com |
| Base Domain | hodinkee.com |
| Scan Status | Ok |
| Last Scan | 2024-06-16T23:52:32+00:00 |
| Next Scan | 2024-06-30T23:52:32+00:00 |
Last Scan
| Scanned | 2024-06-16T23:52:32+00:00 |
| URL | https://www.hodinkee.com/robots.txt |
| Domain IPs | 18.205.222.128, 52.202.168.65, 54.161.241.46, 54.237.133.81 |
| Response IP | 18.205.222.128 |
| Found | Yes |
| Hash | b62789aff8298fcaba7e1c5d8139a0b895cddcd8f2cd2569ba89790db29cb9f3 |
| SimHash | 3a852d8d7670 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /videos/*/page |
| Disallow | /videos?sort |
| Disallow | /browse/*sort/top_this_ |
| Disallow | /search |
| Disallow | /*US_CENSUS_NAME* |
| Disallow | /articles/*US_CENSUS_NAME* |
Comments