semtech.com
robots.txt
Robots Exclusion Standard data for semtech.com
Resource Scan
Scan Details
Site Domain | semtech.com |
Base Domain | semtech.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-31T10:01:17+00:00 |
Next Scan | 2024-11-29T10:01:17+00:00 |
Last Successful Scan
Scanned | 2024-01-12T09:50:02+00:00 |
URL | https://semtech.com/robots.txt |
Redirect | https://www.semtech.com/robots.txt |
Redirect Domain | www.semtech.com |
Redirect Base | semtech.com |
Domain IPs | 149.97.171.6 |
Redirect IPs | 13.33.88.12, 13.33.88.15, 13.33.88.56, 13.33.88.94, 2600:9000:223b:2e00:4:f190:a240:93a1, 2600:9000:223b:3000:4:f190:a240:93a1, 2600:9000:223b:3600:4:f190:a240:93a1, 2600:9000:223b:6800:4:f190:a240:93a1, 2600:9000:223b:c400:4:f190:a240:93a1, 2600:9000:223b:d200:4:f190:a240:93a1, 2600:9000:223b:d400:4:f190:a240:93a1, 2600:9000:223b:da00:4:f190:a240:93a1 |
Response IP | 13.226.175.6 |
Found | Yes |
Hash | a068b86cd6804743a538d82410084df20a09b4f02f5ead2f81982ba808fc0c5b |
SimHash | e084dc62baf2 |
Groups
*
Rule | Path |
---|---|
Disallow | /form_request/ |
Disallow | /mysemtech/ |
Disallow | /quality_search_result/ |
Disallow | /selector/ |
Disallow | /cross-reference-search/ |
Disallow | /uploads/*.html |
Disallow | /sfdc/client/ |
Disallow | /quality/search-pb-lead-free-rohs-green |
Disallow | /netcomponent/ |
Disallow | /hubfs/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.semtech.com/sitemap.xml |