blogs.bu.edu
robots.txt

Robots Exclusion Standard data for blogs.bu.edu

Resource Scan

Scan Details

Site Domain blogs.bu.edu
Base Domain bu.edu
Scan Status Ok
Last Scan2025-07-17T13:53:20+00:00
Next Scan 2025-08-16T13:53:20+00:00

Last Scan

Scanned2025-07-17T13:53:20+00:00
URL https://blogs.bu.edu/robots.txt
Domain IPs 65.9.112.114, 65.9.112.125, 65.9.112.37, 65.9.112.90
Response IP 18.244.87.127
Found Yes
Hash 73ec063f00ced509d85290bd4b85194af7ae3e62278a20eb0bb2fc44c4ae4376
SimHash 6101d8008f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://blogs.bu.edu/wp-sitemap.xml