us.mejoresrutas.com
robots.txt

Robots Exclusion Standard data for us.mejoresrutas.com

Resource Scan

Scan Details

Site Domain us.mejoresrutas.com
Base Domain mejoresrutas.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2/12/2025, 12:39:25 PM
Next Scan 4/13/2025, 12:39:25 PM

Last Successful Scan

Scanned5/26/2024, 12:36:40 PM
URL https://us.mejoresrutas.com/robots.txt
Redirect https://usa.mejoresrutas.com/robots.txt
Redirect Domain usa.mejoresrutas.com
Redirect Base mejoresrutas.com
Domain IPs 104.21.28.117, 172.67.145.230, 2606:4700:3033::ac43:91e6, 2606:4700:3037::6815:1c75
Redirect IPs 104.21.28.117, 172.67.145.230, 2606:4700:3033::ac43:91e6, 2606:4700:3037::6815:1c75
Response IP 104.21.28.117
Found Yes
Hash 970cd407e8e8b128d0ca3ef7fd6d3a103bb45abe452b2492a65d8ac322da9c3a
SimHash 670d9c45c711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://usa.mejoresrutas.com/sitemap.xml

Warnings

  • `host` is not a known field.