octopart-clicks.com
robots.txt

Robots Exclusion Standard data for octopart-clicks.com

Resource Scan

Scan Details

Site Domain octopart-clicks.com
Base Domain octopart-clicks.com
Scan Status Ok
Last Scan2024-05-11T16:24:01+00:00
Next Scan 2024-06-10T16:24:01+00:00

Last Scan

Scanned2024-05-11T16:24:01+00:00
URL https://octopart-clicks.com/robots.txt
Redirect https://octopart.com/robots.txt
Redirect Domain octopart.com
Redirect Base octopart.com
Domain IPs 104.18.26.240, 104.18.27.240, 2606:4700::6812:1af0, 2606:4700::6812:1bf0
Redirect IPs 104.18.10.212, 104.18.11.212, 2606:4700::6812:ad4, 2606:4700::6812:bd4
Response IP 104.18.10.212
Found Yes
Hash 4e173fc864b4fbab09772fa23aa5b8eadb678f5e62ceb3b8bf4cc162abb1950a
SimHash 650df844d7f0

Groups

*

Rule Path
Disallow /api/v2/*
Disallow /api/v3/*
Disallow /static/api/v3/examples*
Disallow /detail/all_breaks?sid*
Disallow /bom-tool/*
Disallow /_widget/
Disallow /_convert/xref*
Disallow /segment/js
Disallow /opatz8j6/*
Disallow /click/track*

adsbot-google

Rule Path
Allow /
Disallow /segment

Other Records

Field Value
sitemap https://octopart.com/sitemap_index.xml
sitemap https://octopart.com/product-sitemap-index.xml