departures.com
robots.txt

Robots Exclusion Standard data for departures.com

Resource Scan

Scan Details

Site Domain departures.com
Base Domain departures.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-06T05:53:19+00:00
Next Scan 2024-12-06T05:53:19+00:00

Last Successful Scan

Scanned2023-12-25T23:44:39+00:00
URL https://www.departures.com/robots.txt
Domain IPs 3.93.92.115, 54.205.213.194
Response IP 54.205.213.194
Found Yes
Hash 1ca64d694e8e56c2bec5f9619d27753be4402fc6b81565a332712ea56519a716
SimHash 43101d763713

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.departures.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.departures.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/