stevens.edu
robots.txt

Robots Exclusion Standard data for stevens.edu

Resource Scan

Scan Details

Site Domain stevens.edu
Base Domain stevens.edu
Scan Status Ok
Last Scan2024-08-29T13:37:36+00:00
Next Scan 2024-09-28T13:37:36+00:00

Last Scan

Scanned2024-08-29T13:37:36+00:00
URL https://stevens.edu/robots.txt
Redirect https://www.stevens.edu/robots.txt
Redirect Domain www.stevens.edu
Redirect Base stevens.edu
Domain IPs 104.18.130.28, 104.18.131.28
Redirect IPs 104.18.130.28, 104.18.131.28
Response IP 104.18.131.28
Found Yes
Hash a46b1cbe54b611bfff92a7b04cb56acc5006ab97a7dc009f36683c195353dd81
SimHash 6b508c72e733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.stevens.edu/sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.