directaroja.eu
robots.txt

Robots Exclusion Standard data for directaroja.eu

Resource Scan

Scan Details

Site Domain directaroja.eu
Base Domain directaroja.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-13T19:42:00+00:00
Next Scan 2025-07-12T19:42:00+00:00

Last Successful Scan

Scanned2023-03-03T18:31:17+00:00
URL https://directaroja.eu/robots.txt
Domain IPs 104.21.24.114, 172.67.218.93, 2606:4700:3035::6815:1872, 2606:4700:3035::ac43:da5d
Response IP 104.21.24.114
Found Yes
Hash 401ddd89c09cb9670aaca08ddfd15b656e719d7fb33435053d777b7e0828c52a
SimHash 43089ea2c6b3

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 29

Other Records

Field Value
sitemap https://directaroja.eu/sitemap_index.xml

Comments

  • vestacp autogenerated robots.txt