Log In Sign Up

webmauritius.com
robots.txt

Robots Exclusion Standard data for webmauritius.com

Resource Scan

Scan Details

Site Domain webmauritius.com
Base Domain webmauritius.com
Scan Status Ok
Last Scan2025-12-16T17:44:50+00:00
Next Scan 2025-12-23T17:44:50+00:00

Last Scan

Scanned2025-12-16T17:44:50+00:00
URL https://webmauritius.com/robots.txt
Domain IPs 104.21.66.170, 172.67.162.111, 2606:4700:3036::ac43:a26f, 2606:4700:3037::6815:42aa
Response IP 104.21.66.170
Found Yes
Hash 1ed6e7c320cc47a0b17ad6424245f23f99830e285940bd1d3a37f56de2a582e1
SimHash 0935d0d345d0

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yandex

Rule Path
Disallow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Comments

  • ------------------------------------------------------------------
  • __ __ _ __ __ _ _ _
  • \ \ / / | | | \/ | (_) | (_)
  • \ \ /\ / /__| |__ | \ / | __ _ _ _ _ __ _| |_ _ _ _ ___
  • \ \/ \/ / _ \ '_ \| |\/| |/ _` | | | | '__| | __| | | | / __|
  • \ /\ / __/ |_) | | | | (_| | |_| | | | | |_| | |_| \__ \
  • \/ \/ \___|_.__/|_| |_|\__,_|\__,_|_| |_|\__|_|\__,_|___/
  • -------------------------------------------------------------------
Back to top