exed.hbs.edu
robots.txt

Robots Exclusion Standard data for exed.hbs.edu

Resource Scan

Scan Details

Site Domain exed.hbs.edu
Base Domain hbs.edu
Scan Status Ok
Last Scan2024-09-27T14:47:57+00:00
Next Scan 2024-10-27T14:47:57+00:00

Last Scan

Scanned2024-09-27T14:47:57+00:00
URL https://exed.hbs.edu/robots.txt
Redirect https://www.exed.hbs.edu/robots.txt
Redirect Domain www.exed.hbs.edu
Redirect Base hbs.edu
Domain IPs 128.103.124.100
Redirect IPs 13.225.4.32, 13.225.4.47, 13.225.4.75, 13.225.4.93
Response IP 13.225.4.93
Found Yes
Hash 6a560026211b49f1d8f1e40fb508a5fa2a2fe4ba838b0b3d54d004c7e344c735
SimHash 891059704751

Groups

*

Rule Path
Allow /
Disallow /test
Disallow /admin
Disallow /example
Disallow /experiments
Disallow /contentful-render
Disallow /contentful-preview
Disallow /health$