diariodolimia.gal
robots.txt

Robots Exclusion Standard data for diariodolimia.gal

Resource Scan

Scan Details

Site Domain diariodolimia.gal
Base Domain diariodolimia.gal
Scan Status Ok
Last Scan2024-05-16T03:52:26+00:00
Next Scan 2024-05-23T03:52:26+00:00

Last Scan

Scanned2024-05-16T03:52:26+00:00
URL https://diariodolimia.gal/robots.txt
Redirect https://www.diariodolimia.gal/robots.txt
Redirect Domain www.diariodolimia.gal
Redirect Base diariodolimia.gal
Domain IPs 104.21.27.126, 172.67.142.152, 2606:4700:3031::ac43:8e98, 2606:4700:3032::6815:1b7e
Redirect IPs 104.21.27.126, 172.67.142.152, 2606:4700:3031::ac43:8e98, 2606:4700:3032::6815:1b7e
Response IP 104.21.27.126
Found Yes
Hash 101388c0be4e96b834d5da69fb1dad93d8819512ae0284ceefd88f4a8ab08803
SimHash b820cc60a9d3

Groups

*

Rule Path
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self
Disallow /api
Disallow /admin

Other Records

Field Value
sitemap https://www.diariodolimia.gal/sitemap.news.xml.gz
sitemap https://www.diariodolimia.gal/sitemap.xml