criar.cat
robots.txt
Robots Exclusion Standard data for criar.cat
Resource Scan
Scan Details
| Site Domain | criar.cat |
| Base Domain | criar.cat |
| Scan Status | Ok |
| Last Scan | 2024-11-16T18:43:23+00:00 |
| Next Scan | 2024-11-23T18:43:23+00:00 |
Last Scan
| Scanned | 2024-11-16T18:43:23+00:00 |
| URL | https://criar.cat/robots.txt |
| Redirect | https://www.criar.cat/robots.txt |
| Redirect Domain | www.criar.cat |
| Redirect Base | criar.cat |
| Domain IPs | 104.26.12.227, 104.26.13.227, 172.67.70.37, 2606:4700:20::681a:ce3, 2606:4700:20::681a:de3, 2606:4700:20::ac43:4625 |
| Redirect IPs | 104.26.12.227, 104.26.13.227, 172.67.70.37, 2606:4700:20::681a:ce3, 2606:4700:20::681a:de3, 2606:4700:20::ac43:4625 |
| Response IP | 104.26.13.227 |
| Found | Yes |
| Hash | 80a9f0939d6a2ee339a848c8acfb1bb5b26d0c8f856bcd092a6e4a81ddaa0f29 |
| SimHash | 91400d418690 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_call* |
| Disallow | /*breaking-news-ca.json* |
| Disallow | /cercador.html?* |
| Disallow | /amp-news-list.html* |
| Disallow | *?idComment=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.criar.cat/uploads/feeds/google_sitemap_criar_ca.xml |