library.northeastern.edu
robots.txt

Robots Exclusion Standard data for library.northeastern.edu

Resource Scan

Scan Details

Site Domain library.northeastern.edu
Base Domain northeastern.edu
Scan Status Ok
Last Scan2024-06-07T01:50:19+00:00
Next Scan 2024-07-07T01:50:19+00:00

Last Scan

Scanned2024-06-07T01:50:19+00:00
URL https://library.northeastern.edu/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash 44e34188d3a5ff4203ddce7117176dd60023483e6600077929d84c1d7dd0bb1e
SimHash 6d11c5446d91

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://library.northeastern.edu/sitemap.xml