aaronswartzday.org
robots.txt

Robots Exclusion Standard data for aaronswartzday.org

Resource Scan

Scan Details

Site Domain aaronswartzday.org
Base Domain aaronswartzday.org
Scan Status Ok
Last Scan2025-09-17T20:32:30+00:00
Next Scan 2025-10-17T20:32:30+00:00

Last Scan

Scanned2025-09-17T20:32:30+00:00
URL https://aaronswartzday.org/robots.txt
Redirect https://www.aaronswartzday.org/robots.txt
Redirect Domain www.aaronswartzday.org
Redirect Base aaronswartzday.org
Domain IPs 104.196.127.133
Redirect IPs 104.196.127.133
Response IP 104.196.127.133
Found Yes
Hash e14fa15340793b058515f094a56832cb66bcedb298107b195242e2ea8dfbd51f
SimHash 6300dc408792

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.aaronswartzday.org/wp-sitemap.xml