annenberggenspace.org
robots.txt

Robots Exclusion Standard data for annenberggenspace.org

Resource Scan

Scan Details

Site Domain annenberggenspace.org
Base Domain annenberggenspace.org
Scan Status Ok
Last Scan2025-05-12T00:56:30+00:00
Next Scan 2025-06-11T00:56:30+00:00

Last Scan

Scanned2025-05-12T00:56:30+00:00
URL https://annenberggenspace.org/robots.txt
Redirect https://www.annenberggenspace.org/robots.txt
Redirect Domain www.annenberggenspace.org
Redirect Base annenberggenspace.org
Domain IPs 104.21.62.40, 172.67.219.243, 2606:4700:3034::ac43:dbf3, 2606:4700:3035::6815:3e28
Redirect IPs 104.21.62.40, 172.67.219.243, 2606:4700:3034::ac43:dbf3, 2606:4700:3035::6815:3e28
Response IP 172.67.219.243
Found Yes
Hash 61427cc4605fbb0a796fd03ea536c9e1ba2d040336f4b7a9bf67aa5798d4b597
SimHash c3001800afa2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.annenberggenspace.org/sitemaps.xml

Comments

  • Pantheon's documentation on robots.txt: https://pantheon.io/docs/bots-and-indexing/