conservingcarolina.org
robots.txt
Robots Exclusion Standard data for conservingcarolina.org
Resource Scan
Scan Details
Site Domain | conservingcarolina.org |
Base Domain | conservingcarolina.org |
Scan Status | Ok |
Last Scan | 2024-04-28T07:09:49+00:00 |
Next Scan | 2024-05-28T07:09:49+00:00 |
Last Scan
Scanned | 2024-04-28T07:09:49+00:00 |
URL | https://conservingcarolina.org/robots.txt |
Domain IPs | 104.21.80.11, 172.67.172.146, 2606:4700:3031::ac43:ac92, 2606:4700:3034::6815:500b |
Response IP | 104.21.80.11 |
Found | Yes |
Hash | f3bd36e9593151cf0121f03ad650dc54b03eabf7a68f2b00258a64a65e17d2b3 |
SimHash | e584cd406fab |
Groups
*
Rule | Path |
---|---|
Disallow | /calendar/action%3Aposterboard/ |
Disallow | /calendar/action%3Aagenda/ |
Disallow | /calendar/action%3Aoneday/ |
Disallow | /calendar/action%3Amonth/ |
Disallow | /calendar/action%3Aweek/ |
Disallow | /calendar/action%3Amap/ |
Disallow | /calendar/action~posterboard/ |
Disallow | /calendar/action~agenda/ |
Disallow | /calendar/action~oneday/ |
Disallow | /calendar/action~month/ |
Disallow | /calendar/action~week/ |
Disallow | /calendar/action~stream/ |
Disallow | /events/action~posterboard/ |
Disallow | /events/action~agenda/ |
Disallow | /events/action~oneday/ |
Disallow | /events/action~month/ |
Disallow | /events/action~week/ |
Disallow | /events/action~stream/ |
Allow | /*.css |
Allow | /*.js |
Disallow | /*? |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Comments