davisbands.org
robots.txt

Robots Exclusion Standard data for davisbands.org

Resource Scan

Scan Details

Site Domain davisbands.org
Base Domain davisbands.org
Scan Status Ok
Last Scan2025-10-02T20:45:25+00:00
Next Scan 2025-11-01T20:45:25+00:00

Last Scan

Scanned2025-10-02T20:45:25+00:00
URL https://davisbands.org/robots.txt
Redirect https://www.davisbands.org/robots.txt
Redirect Domain www.davisbands.org
Redirect Base davisbands.org
Domain IPs 199.34.228.42
Redirect IPs 199.34.228.42
Response IP 199.34.228.42
Found Yes
Hash 8a8fb1df89a0d27a0bf31339bf120cc925bf76e142a4e3ab5cbb49687e974cc5
SimHash 8354d450e713

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//calendar.google.com/calendar/embed?src=davishighbands%40gmail.com&ctz=America%2FDenver
Disallow /https%3A//calendar.google.com/calendar/embed?src=davishighbands%40gmail.com&ctz=America%2FDenver
Disallow /https%3A//www.dropbox.com/sh/wlj2m1mj9gi43gn/AACZHZ-1zC_NGxkM0im__o40a?dl=0
Disallow /groups.html
Disallow /about.html
Disallow /color-guard1.html
Disallow /homedev.html
Disallow /concert-bands1.html
Disallow /marching-band1.html

Other Records

Field Value
sitemap https://www.davisbands.org/sitemap.xml