watchcrunch.com
robots.txt
Robots Exclusion Standard data for watchcrunch.com
Resource Scan
Scan Details
| Site Domain | watchcrunch.com |
| Base Domain | watchcrunch.com |
| Scan Status | Ok |
| Last Scan | 2025-12-09T23:02:48+00:00 |
| Next Scan | 2025-12-16T23:02:48+00:00 |
Last Scan
| Scanned | 2025-12-09T23:02:48+00:00 |
| URL | https://watchcrunch.com/robots.txt |
| Redirect | https://www.watchcrunch.com/robots.txt |
| Redirect Domain | www.watchcrunch.com |
| Redirect Base | watchcrunch.com |
| Domain IPs | 104.26.10.231, 104.26.11.231, 172.67.75.143, 2606:4700:20::681a:ae7, 2606:4700:20::681a:be7, 2606:4700:20::ac43:4b8f |
| Redirect IPs | 143.204.55.128, 143.204.55.2, 143.204.55.33, 143.204.55.61, 2600:9000:26e8:1c00:e:229c:ba80:93a1, 2600:9000:26e8:2200:e:229c:ba80:93a1, 2600:9000:26e8:3600:e:229c:ba80:93a1, 2600:9000:26e8:a400:e:229c:ba80:93a1, 2600:9000:26e8:a600:e:229c:ba80:93a1, 2600:9000:26e8:c00:e:229c:ba80:93a1, 2600:9000:26e8:c200:e:229c:ba80:93a1, 2600:9000:26e8:ce00:e:229c:ba80:93a1 |
| Response IP | 3.169.71.107 |
| Found | Yes |
| Hash | 936a59c6622ee264baac33c4450c9b30a5fac93030004f8bb2836df7336849d1 |
| SimHash | e91e114409c3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /html/ |
| Disallow | /lazyload/ |
| Disallow | /tags/reviews/ |
| Disallow | /*?post_ids=* |
| Disallow | /horologe/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.watchcrunch.com/sitemap-index.xml |