msi.com
robots.txt
Robots Exclusion Standard data for msi.com
Resource Scan
Scan Details
Site Domain | msi.com |
Base Domain | msi.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-25T13:42:52+00:00 |
Next Scan | 2024-07-24T13:42:52+00:00 |
Last Successful Scan
Scanned | 2024-03-04T13:12:57+00:00 |
URL | https://msi.com/robots.txt |
Redirect | https://www.msi.com/robots.txt |
Redirect Domain | www.msi.com |
Redirect Base | msi.com |
Domain IPs | 52.89.164.39 |
Redirect IPs | 23.210.98.100 |
Response IP | 23.42.35.47 |
Found | Yes |
Hash | 9907ec11ff56b7af209219346bd95091fc720e7c34f03b2e5557b6b2b9fa99da |
SimHash | 0054d820ef72 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /search/* |
Disallow | /Landing/creator-awards/* |
Disallow | /files/pdf/* |
Disallow | /Landing/arlw |