corpgov.law.harvard.edu
robots.txt
Robots Exclusion Standard data for corpgov.law.harvard.edu
Resource Scan
Scan Details
| Site Domain | corpgov.law.harvard.edu |
| Base Domain | harvard.edu |
| Scan Status | Ok |
| Last Scan | 2024-04-22T08:03:53+00:00 |
| Next Scan | 2024-05-22T08:03:53+00:00 |
Last Scan
| Scanned | 2024-04-22T08:03:53+00:00 |
| URL | https://corpgov.law.harvard.edu/robots.txt |
| Domain IPs | 141.193.213.20, 141.193.213.21 |
| Response IP | 141.193.213.20 |
| Found | Yes |
| Hash | 10ae300570f0ab6c6c0c66223a48f737a8d6b884a16ba5060fd82755e6855fba |
| SimHash | cc2d5d8cfbf3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tag/ |
| Disallow | /category/ |
| Disallow | /lawfirm/ |
| Disallow | /contributor/ |
| Disallow | /page/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |