Log In Sign Up

bwtexperiences.com
robots.txt

Robots Exclusion Standard data for bwtexperiences.com

Resource Scan

Scan Details

Site Domain bwtexperiences.com
Base Domain bwtexperiences.com
Scan Status Ok
Last Scan2024-11-18T15:45:53+00:00
Next Scan 2024-12-02T15:45:53+00:00

Last Scan

Scanned2024-11-18T15:45:53+00:00
URL https://bwtexperiences.com/robots.txt
Redirect https://www.bwtexperiences.com/robots.txt
Redirect Domain www.bwtexperiences.com
Redirect Base bwtexperiences.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.142, 76.76.21.93
Response IP 76.76.21.93
Found Yes
Hash 16d6795aabadcfc18a3ff129a942c7358928c51b75ed7c233f297ef1f9fe5010
SimHash 624cd2c1f911

Groups

*

Rule Path
Allow /

black-listed-bot

Rule Path
Disallow /user-onboarding
Disallow /welcome
Disallow /profile/*
Disallow /booking/*
Disallow /checkout/*
Disallow /join/*
Back to top

Other Records

Field Value
sitemap https://www.bwtexperiences.com/sitemap.xml
sitemap https://www.bwtexperiences.com/sitemaps/experiences.xml
sitemap https://www.bwtexperiences.com/sitemaps/tripflix.xml
sitemap https://www.bwtexperiences.com/sitemaps/blogs.xml
sitemap https://www.bwtexperiences.com/sitemaps/experience-listing.xml
Back to top

Comments

  • *
  • black-listed-bot
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top