backpackjoy.com
robots.txt

Robots Exclusion Standard data for backpackjoy.com

Resource Scan

Scan Details

Site Domain backpackjoy.com
Base Domain backpackjoy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-30T02:26:20+00:00
Next Scan 2024-10-07T02:26:20+00:00

Last Successful Scan

Scanned2024-09-22T02:13:28+00:00
URL https://backpackjoy.com/robots.txt
Domain IPs 104.21.93.44, 172.67.204.105, 2606:4700:3035::ac43:cc69, 2606:4700:3036::6815:5d2c
Response IP 104.21.93.44
Found Yes
Hash 0215fde1e4d068d65ae46a3fb2b78921fa46bfc4133c74f88d75c1695065e5ff
SimHash e54b1c464dd1

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://backpackjoy.com/sitemap_index.xml

Comments

  • robots.txt generated by atozseotools.com