huelvahoy.com
robots.txt
Robots Exclusion Standard data for huelvahoy.com
Resource Scan
Scan Details
Site Domain | huelvahoy.com |
Base Domain | huelvahoy.com |
Scan Status | Ok |
Last Scan | 2024-11-04T06:40:49+00:00 |
Next Scan | 2024-11-11T06:40:49+00:00 |
Last Scan
Scanned | 2024-11-04T06:40:49+00:00 |
URL | https://huelvahoy.com/robots.txt |
Redirect | https://www.huelvahoy.com/robots.txt |
Redirect Domain | www.huelvahoy.com |
Redirect Base | huelvahoy.com |
Domain IPs | 104.21.47.242, 172.67.174.141, 2606:4700:3030::6815:2ff2, 2606:4700:3032::ac43:ae8d |
Redirect IPs | 104.21.47.242, 172.67.174.141, 2606:4700:3030::6815:2ff2, 2606:4700:3032::ac43:ae8d |
Response IP | 104.21.47.242 |
Found | Yes |
Hash | 10ab01ae79237cdb920fc66ce8e1190c516f7cbb59fd06e26a9ca3a54584612f |
SimHash | 3820c924a9d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /harming/humans |
Disallow | /ignoring/human/orders |
Disallow | /harm/to/self |
Disallow | /api |
Disallow | /admin |
Other Records
Field | Value |
---|---|
sitemap | https://www.huelvahoy.com/sitemap.news.xml.gz |
sitemap | https://www.huelvahoy.com/sitemap.xml |