Log In Sign Up

world.expeditions.com
robots.txt

Robots Exclusion Standard data for world.expeditions.com

Resource Scan

Scan Details

Site Domain world.expeditions.com
Base Domain expeditions.com
Scan Status Ok
Last Scan2024-04-24T09:30:40+00:00
Next Scan 2024-05-24T09:30:40+00:00

Last Scan

Scanned2024-04-24T09:30:40+00:00
URL https://world.expeditions.com/robots.txt
Domain IPs 172.66.40.136, 172.66.43.120, 2606:4700:3108::ac42:2888, 2606:4700:3108::ac42:2b78
Response IP 172.66.43.120
Found Yes
Hash c14660974dc8a07f6451b3aa0c58737254a4b75fc6588ee12deaf38342356db0
SimHash 48b59952cff3

Groups

*
adsbot-google
adsbot-google-mobile

Rule Path
Allow /
Disallow /episerver/
Disallow /globalassets/der-images/older/
Disallow /sellsheetscontent/
Back to top

Other Records

Field Value
sitemap https://world.expeditions.com/sitemap1.xml
sitemap https://world.expeditions.com/sitemapImages.xml
sitemap https://world.expeditions.com/sitemapVideo.xml
sitemap https://world.expeditions.com/sitemapItineraries.xml
sitemap https://world.expeditions.com/sitemapDestinations.xml
sitemap https://world.expeditions.com/sitemapLandings.xml
sitemap https://world.expeditions.com/sitemapArticles.xml
sitemap https://world.expeditions.com/sitemapDER1.xml
sitemap https://world.expeditions.com/sitemapDER2.xml
sitemap https://world.expeditions.com/sitemapDER3.xml
sitemap https://world.expeditions.com/sitemapDER4.xml
sitemap https://world.expeditions.com/sitemapDER5.xml
sitemap https://world.expeditions.com/sitemapDER6.xml
sitemap https://world.expeditions.com/sitemap.xml
Back to top

Comments

  • Tell all robots not to index any of the pages under the /episerver path.
  • Add a link to the site-map. Unfortunately this must be an absolute URL.
Back to top