aquariumofpacific.org
robots.txt

Robots Exclusion Standard data for aquariumofpacific.org

Resource Scan

Scan Details

Site Domain aquariumofpacific.org
Base Domain aquariumofpacific.org
Scan Status Ok
Last Scan2024-05-21T11:11:46+00:00
Next Scan 2024-06-20T11:11:46+00:00

Last Scan

Scanned2024-05-21T11:11:46+00:00
URL https://www.aquariumofpacific.org/robots.txt
Domain IPs 104.26.14.66, 104.26.15.66, 172.67.75.174, 2606:4700:20::681a:e42, 2606:4700:20::681a:f42, 2606:4700:20::ac43:4bae
Response IP 172.67.75.174
Found Yes
Hash 4806004b3e328d8425e2092ed59f29fdd245166ccfc1fa1eae15a38177825051
SimHash ec6fd4512104

Groups

*

Rule Path
Disallow /_mm
Disallow /_notes
Disallow /_baks
Disallow /MMWIP
Disallow /web_coupon
Disallow /member
Disallow /xyz78%21%40h%5E8klP0o5
Disallow /xyz78%21%40h%5E8klP0o5
Disallow /2010exhibits
Disallow /exhibits/otters
Disallow /exhibits/animalcarecenter
Disallow /topaztimes
Disallow /m3emiiibe3r
Disallow /privpdf

Other Records

Field Value
crawl-delay 30

googlebot

Rule Path
Disallow *.csi
Disallow /member
Disallow /xyz78%21%40h%5E8klP0o5
Disallow /m3emiiibe3r
Disallow /privpdf
Disallow /web_coupon

Other Records

Field Value
crawl-delay 10

swiftbot

Rule Path
Disallow /events/calendar/