nu.edu
robots.txt

Robots Exclusion Standard data for nu.edu

Resource Scan

Scan Details

Site Domain nu.edu
Base Domain nu.edu
Scan Status Ok
Last Scan2024-06-20T07:26:43+00:00
Next Scan 2024-07-20T07:26:43+00:00

Last Scan

Scanned2024-06-20T07:26:43+00:00
URL https://nu.edu/robots.txt
Redirect https://www.nu.edu/robots.txt
Redirect Domain www.nu.edu
Redirect Base nu.edu
Domain IPs 192.0.66.2
Redirect IPs 104.18.41.225, 172.64.146.31, 2606:4700:4400::6812:29e1, 2606:4700:4400::ac40:921f
Response IP 104.18.41.225
Found Yes
Hash 0a3e93349e02f502a15bf1db4e5f3b140d66f9ee9c013ae3a8ae06dc91bf0eff
SimHash 036c0ac4218b

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.nu.edu/sitemap_index.xml
sitemap https://www.nu.edu/sitemap_index.xml
sitemap https://community.nu.edu/sitemap_index.xml
sitemap https://apply.nu.edu/sitemap_index.xml
sitemap https://law.nu.edu/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 15 invalid lines.