murciadiario.com
robots.txt
Robots Exclusion Standard data for murciadiario.com
Resource Scan
Scan Details
| Site Domain | murciadiario.com |
| Base Domain | murciadiario.com |
| Scan Status | Ok |
| Last Scan | 2024-06-29T11:39:05+00:00 |
| Next Scan | 2024-07-06T11:39:05+00:00 |
Last Scan
| Scanned | 2024-06-29T11:39:05+00:00 |
| URL | https://murciadiario.com/robots.txt |
| Redirect | https://www.murciadiario.com/robots.txt |
| Redirect Domain | www.murciadiario.com |
| Redirect Base | murciadiario.com |
| Domain IPs | 104.21.26.121, 172.67.168.72, 2606:4700:3035::ac43:a848, 2606:4700:3037::6815:1a79 |
| Redirect IPs | 104.21.26.121, 172.67.168.72, 2606:4700:3035::ac43:a848, 2606:4700:3037::6815:1a79 |
| Response IP | 104.21.26.121 |
| Found | Yes |
| Hash | d46a8e36b98af97e311948b149d71f64a90442df69431f37f75fd0dbb8546c9a |
| SimHash | 8020cc60e9d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /harming/humans |
| Disallow | /ignoring/human/orders |
| Disallow | /harm/to/self |
| Disallow | /api |
| Disallow | /admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.murciadiario.com/sitemap.news.xml.gz |
| sitemap | https://www.murciadiario.com/sitemap.xml |