service.northeastern.edu
robots.txt

Robots Exclusion Standard data for service.northeastern.edu

Resource Scan

Scan Details

Site Domain service.northeastern.edu
Base Domain northeastern.edu
Scan Status Ok
Last Scan2025-06-29T16:05:47+00:00
Next Scan 2025-07-13T16:05:47+00:00

Last Scan

Scanned2025-06-29T16:05:47+00:00
URL https://service.northeastern.edu/robots.txt
Domain IPs 149.96.35.101
Response IP 149.96.35.101
Found Yes
Hash 5e9f41148a3f33e66419e6f5136f4d73203619ec47c0c63f55716f4df9476fd9
SimHash 280ccc02cd83

Groups

*

Rule Path
Allow /tech
Allow /tech*
Allow /*.gif
Allow /*.gifx
Allow /*.png
Allow /*.pngx
Allow /*.jpg
Allow /*.jpgx
Allow /*.jpeg
Allow /*.jpegx
Allow /*.jsdbx
Allow /*.jsx
Disallow

Other Records

Field Value
sitemap https://service.northeastern.edu/knowledgeSiteMap.do
sitemap https://service.northeastern.edu/serviceCatalogSiteMap.do

Warnings

  • 2 invalid lines.