rubitv.cat
robots.txt
Robots Exclusion Standard data for rubitv.cat
Resource Scan
Scan Details
Site Domain | rubitv.cat |
Base Domain | rubitv.cat |
Scan Status | Ok |
Last Scan | 2024-11-07T10:51:34+00:00 |
Next Scan | 2024-11-14T10:51:34+00:00 |
Last Scan
Scanned | 2024-11-07T10:51:34+00:00 |
URL | https://rubitv.cat/robots.txt |
Redirect | https://www.rubitv.cat/robots.txt |
Redirect Domain | www.rubitv.cat |
Redirect Base | rubitv.cat |
Domain IPs | 104.26.2.221, 104.26.3.221, 172.67.70.146, 2606:4700:20::681a:2dd, 2606:4700:20::681a:3dd, 2606:4700:20::ac43:4692 |
Redirect IPs | 104.26.2.221, 104.26.3.221, 172.67.70.146, 2606:4700:20::681a:2dd, 2606:4700:20::681a:3dd, 2606:4700:20::ac43:4692 |
Response IP | 104.26.3.221 |
Found | Yes |
Hash | fc3f789a0badb7a8767d932e96705e185828f4093ffb807d9c6ba40ebea8d67f |
SimHash | b5404b418790 |
Groups
*
Rule | Path |
---|---|
Disallow | /_call* |
Disallow | /*breaking-news-ca.json* |
Disallow | /cercador.html?* |
Disallow | /amp-news-list.html* |
Disallow | *?idComment=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.rubitv.cat/uploads/feeds/google_sitemap_rubitv_ca.xml |