animalia.bio
robots.txt

Robots Exclusion Standard data for animalia.bio

Resource Scan

Scan Details

Site Domain animalia.bio
Base Domain animalia.bio
Scan Status Ok
Last Scan2024-05-24T21:56:05+00:00
Next Scan 2024-05-31T21:56:05+00:00

Last Scan

Scanned2024-05-24T21:56:05+00:00
URL https://animalia.bio/robots.txt
Domain IPs 104.26.10.181, 104.26.11.181, 172.67.70.45, 2606:4700:20::681a:ab5, 2606:4700:20::681a:bb5, 2606:4700:20::ac43:462d
Response IP 104.26.10.181
Found Yes
Hash c96bb56260450d5aad41fc0340c2f4b6b292e30736ed96f8a8fb4c8e9e5d3dc0
SimHash 69009c52e790

Groups

*

Rule Path
Disallow /public/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://animalia.bio/sitemap.xml