Log In Sign Up

mastersports.com
robots.txt

Robots Exclusion Standard data for mastersports.com

Resource Scan

Scan Details

Site Domain mastersports.com
Base Domain mastersports.com
Scan Status Ok
Last Scan2024-11-13T22:14:27+00:00
Next Scan 2024-12-13T22:14:27+00:00

Last Scan

Scanned2024-11-13T22:14:27+00:00
URL https://mastersports.com/robots.txt
Redirect https://www.mastersports.com/robots.txt
Redirect Domain www.mastersports.com
Redirect Base mastersports.com
Domain IPs 216.24.57.1
Redirect IPs 216.24.57.252, 216.24.57.4
Response IP 216.24.57.252
Found Yes
Hash 716c2f91955a0737b5e7aa29bd3c5d6bdaa06b8848e3dc74cadb61eae269b7cd
SimHash ba810d856d50

Groups

*

Rule Path
Disallow /admin
Disallow /admin/*
Disallow /users/*
Back to top

Other Records

Field Value
sitemap http://www.mastersports.com/sitemap
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top