edrl.berkeley.edu
robots.txt

Robots Exclusion Standard data for edrl.berkeley.edu

Resource Scan

Scan Details

Site Domain edrl.berkeley.edu
Base Domain berkeley.edu
Scan Status Ok
Last Scan2025-09-12T19:30:19+00:00
Next Scan 2025-10-12T19:30:19+00:00

Last Scan

Scanned2025-09-12T19:30:19+00:00
URL https://edrl.berkeley.edu/robots.txt
Domain IPs 169.229.226.23, 2607:f140:8801::1:23
Response IP 169.229.226.23
Found Yes
Hash 10339bbe2fe9647717cda7b706e4627544717b3ee4d79bd9a56daab18ddcd46a
SimHash 69009e008f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://edrl.berkeley.edu/sitemap.xml
sitemap https://edrl.berkeley.edu/news-sitemap.xml