Log In Sign Up

msite.reddoorz.com
robots.txt

Robots Exclusion Standard data for msite.reddoorz.com

Resource Scan

Scan Details

Site Domain msite.reddoorz.com
Base Domain reddoorz.com
Scan Status Ok
Last Scan2024-05-21T06:45:29+00:00
Next Scan 2024-06-04T06:45:29+00:00

Last Scan

Scanned2024-05-21T06:45:29+00:00
URL https://msite.reddoorz.com/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bd2, 96.17.96.4, 96.17.96.5
Response IP 23.44.5.96
Found Yes
Hash 539e2adc0910e88a55ce51ffbd17a6c35a1a5fbf46fa34da20521f11a4f05ac9
SimHash aa8d0841e374

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /indonesia/id-id/bookings/
Disallow /indonesia/en-id/bookings/
Disallow /indonesia/en-sg/bookings/
Disallow /indonesia/en/bookings/
Disallow /indonesia/id-id/my-bookings/
Disallow /indonesia/en-id/my-bookings/
Disallow /indonesia/en-sg/my-bookings/
Disallow /indonesia/en/my-bookings/
Disallow /indonesia/id-id/settings
Disallow /indonesia/en-id/settings
Disallow /indonesia/en-sg/settings
Disallow /indonesia/en/settings
Disallow /*/settings
Disallow /*/bookings/invoice/*
Disallow /*/payment
Disallow /*/pah/otpscreen

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.reddoorz.com/sitemaps/sitemap-index.xml
sitemap https://www.reddoorz.com/sitemaps/blog/sitemaps/index.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • Below is the common robots file for https://www.reddoorz.com & https://m.reddoorz.com
Back to top