smusd.org
robots.txt
Robots Exclusion Standard data for smusd.org
Resource Scan
Scan Details
Site Domain | smusd.org |
Base Domain | smusd.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-03T04:57:27+00:00 |
Next Scan | 2024-08-01T04:57:27+00:00 |
Last Successful Scan
Scanned | 2022-12-14T22:16:09+00:00 |
URL | https://smusd.org/robots.txt |
Redirect | https://www.smusd.org/robots.txt/Default.aspx |
Redirect Domain | www.smusd.org |
Redirect Base | smusd.org |
Domain IPs | 162.159.135.49, 162.159.136.49 |
Redirect IPs | 104.18.12.114, 104.18.13.114, 2606:4700::6812:c72, 2606:4700::6812:d72 |
Response IP | 104.18.13.114 |
Found | Yes |
Hash | ca9b915c2c20107b22e53580465fdeb957aa13524446bd4d9f24bdbe4ac560d0 |
SimHash | 8001575009d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /Search/ |
Disallow | /WebApi/ |
Disallow | /WebServices/ |
Disallow | /portal/svc/ |
Disallow | /Common/controls/StaffDirectory/ws/StaffDirectoryWS.asmx/ |
Disallow | /Common/controls/WorkspaceCalendar/ws/WorkspaceCalendarWS.asmx/ |
Disallow | /common/controls/General/CalendarPicker/CalendarPickerWS.asmx/ |
Comments