octopart-clicks.com
robots.txt
Robots Exclusion Standard data for octopart-clicks.com
Resource Scan
Scan Details
Site Domain | octopart-clicks.com |
Base Domain | octopart-clicks.com |
Scan Status | Ok |
Last Scan | 2024-05-11T16:24:01+00:00 |
Next Scan | 2024-06-10T16:24:01+00:00 |
Last Scan
Scanned | 2024-05-11T16:24:01+00:00 |
URL | https://octopart-clicks.com/robots.txt |
Redirect | https://octopart.com/robots.txt |
Redirect Domain | octopart.com |
Redirect Base | octopart.com |
Domain IPs | 104.18.26.240, 104.18.27.240, 2606:4700::6812:1af0, 2606:4700::6812:1bf0 |
Redirect IPs | 104.18.10.212, 104.18.11.212, 2606:4700::6812:ad4, 2606:4700::6812:bd4 |
Response IP | 104.18.10.212 |
Found | Yes |
Hash | 4e173fc864b4fbab09772fa23aa5b8eadb678f5e62ceb3b8bf4cc162abb1950a |
SimHash | 650df844d7f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/v2/* |
Disallow | /api/v3/* |
Disallow | /static/api/v3/examples* |
Disallow | /detail/all_breaks?sid* |
Disallow | /bom-tool/* |
Disallow | /_widget/ |
Disallow | /_convert/xref* |
Disallow | /segment/js |
Disallow | /opatz8j6/* |
Disallow | /click/track* |
Other Records
Field | Value |
---|---|
sitemap | https://octopart.com/sitemap_index.xml |
sitemap | https://octopart.com/product-sitemap-index.xml |