visitmedway.org
robots.txt

Robots Exclusion Standard data for visitmedway.org

Resource Scan

Scan Details

Site Domain visitmedway.org
Base Domain visitmedway.org
Scan Status Ok
Last Scan2024-10-03T14:04:06+00:00
Next Scan 2024-10-10T14:04:06+00:00

Last Scan

Scanned2024-10-03T14:04:06+00:00
URL https://visitmedway.org/robots.txt
Redirect https://www.visitmedway.org/robots.txt
Redirect Domain www.visitmedway.org
Redirect Base visitmedway.org
Domain IPs 104.21.39.166, 172.67.146.197, 2606:4700:3030::6815:27a6, 2606:4700:3032::ac43:92c5
Redirect IPs 104.21.39.166, 172.67.146.197, 2606:4700:3030::6815:27a6, 2606:4700:3032::ac43:92c5
Response IP 104.21.39.166
Found Yes
Hash eca7c815dea9e81bd811e9c140a322d3646dc08a4b93110fbccf6e6ef3790dd9
SimHash 330e7a01ce80

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /scripts/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /usercontrols/
Disallow /xslt/

ninjabot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://{HTTP_HOST}/sitemap.xml

Comments

  • robots.txt
  • Sitemap location
  • Exclude Files From All Robots:
  • End robots.txt file