Log In Sign Up

aurora-expeditions.com
robots.txt

Robots Exclusion Standard data for aurora-expeditions.com

Resource Scan

Scan Details

Site Domain aurora-expeditions.com
Base Domain aurora-expeditions.com
Scan Status Ok
Last Scan2026-02-14T14:16:00+00:00
Next Scan 2026-03-16T14:16:00+00:00

Last Scan

Scanned2026-02-14T14:16:00+00:00
URL https://aurora-expeditions.com/robots.txt
Domain IPs 162.159.140.121, 172.66.0.119, 2606:4700:7::77, 2a06:98c1:58::77
Response IP 172.66.0.119
Found Yes
Hash a703d5242ef93db35e155f89c85902295a11165f2aab9359653258cee4a83da3
SimHash c05510c08383

Groups

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /search/
Disallow /expeditions/DownloadExpeditionItinerary
Disallow /Expeditions/DownloadExpeditionItinerary
Disallow /*/expeditions/DownloadExpeditionItinerary
Disallow /*/Expeditions/DownloadExpeditionItinerary
Disallow /*.pdf$
Allow /
Back to top

Other Records

Field Value
sitemap https://aurora-expeditions.com/sitemap.xml
sitemap https://aexpeditions.co.uk/sitemap.xml
sitemap https://vantagexplorations.com/sitemap.xml
Back to top

Comments

  • Block admin and login
  • Block search results
  • Block itinerary downloads (both Expeditions and expeditions, with or without subpath)
  • Block direct PDF access
  • Allow everything else
  • Sitemaps
Back to top