bayareagreentours.org
robots.txt

Robots Exclusion Standard data for bayareagreentours.org

Resource Scan

Scan Details

Site Domain bayareagreentours.org
Base Domain bayareagreentours.org
Scan Status Ok
Last Scan2025-10-13T18:05:52+00:00
Next Scan 2025-11-12T18:05:52+00:00

Last Scan

Scanned2025-10-13T18:05:52+00:00
URL https://bayareagreentours.org/robots.txt
Redirect https://www.bayareagreentours.org/robots.txt
Redirect Domain www.bayareagreentours.org
Redirect Base bayareagreentours.org
Domain IPs 199.34.228.68
Redirect IPs 199.34.228.68
Response IP 199.34.228.68
Found Yes
Hash 8e07160cbf0a6600bb8ad0bc640ccd763debe45077957d7ee9d68937f877b77e
SimHash 1159da7665b3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /solutionaries-speak.html
Disallow /about-us.html
Disallow /team-building.html
Disallow /volunteer2.html
Disallow /https%3A//www.bayareagreentours.org/donate.html
Disallow /what-we-do.html
Disallow /https%3A//www.flickr.com/photos/bayareagreentours/sets/
Disallow /who-we-are.html
Disallow /support-us.html
Disallow /volunteer3.html
Disallow /events.html
Disallow /get-involved.html
Disallow /resources.html
Disallow /about-us1.html
Disallow /get-involvedbackup.html
Disallow /home-8202023.html
Disallow /home1.html
Disallow /home-backup-532024.html
Disallow /home-backup-5320241.html
Disallow /home-backup-5620241.html

Other Records

Field Value
sitemap https://www.bayareagreentours.org/sitemap.xml