seton.com
robots.txt
Robots Exclusion Standard data for seton.com
Resource Scan
Scan Details
Site Domain | seton.com |
Base Domain | seton.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-19T14:28:35+00:00 |
Next Scan | 2024-10-19T14:28:35+00:00 |
Last Successful Scan
Scanned | 2024-07-29T04:10:35+00:00 |
URL | https://seton.com/robots.txt |
Redirect | https://www.seton.com/robots.txt |
Redirect Domain | www.seton.com |
Redirect Base | seton.com |
Domain IPs | 2600:9000:271a:2400:1b:da61:9d80:93a1, 2600:9000:271a:3000:1b:da61:9d80:93a1, 2600:9000:271a:9400:1b:da61:9d80:93a1, 2600:9000:271a:aa00:1b:da61:9d80:93a1, 2600:9000:271a:ac00:1b:da61:9d80:93a1, 2600:9000:271a:c000:1b:da61:9d80:93a1, 2600:9000:271a:f200:1b:da61:9d80:93a1, 2600:9000:271a:fc00:1b:da61:9d80:93a1, 3.165.82.102, 3.165.82.81, 3.165.82.90, 3.165.82.92 |
Redirect IPs | 2600:9000:271a:3400:1b:da61:9d80:93a1, 2600:9000:271a:6800:1b:da61:9d80:93a1, 2600:9000:271a:6c00:1b:da61:9d80:93a1, 2600:9000:271a:a200:1b:da61:9d80:93a1, 2600:9000:271a:bc00:1b:da61:9d80:93a1, 2600:9000:271a:be00:1b:da61:9d80:93a1, 2600:9000:271a:d200:1b:da61:9d80:93a1, 2600:9000:271a:d600:1b:da61:9d80:93a1, 3.165.82.102, 3.165.82.81, 3.165.82.90, 3.165.82.92 |
Response IP | 3.165.82.90 |
Found | Yes |
Hash | f58155cf9ce79e93ae1c937041b8cabc9d8f421c31d52385101e84237bdfcf01 |
SimHash | e9ad3704e3b2 |
Groups
*
Rule | Path |
---|---|
Allow | /*.png$ |
Allow | /*.jpg$ |
Allow | /*.gif$ |
Disallow | /video/ajax/product/* |
Disallow | /video/ajax/video/* |
Disallow | */zlib/ |
Disallow | */utils/ |
Disallow | */adler32 |
Disallow | */common$ |
Disallow | */crc32v |
Disallow | */messages |
Disallow | */crc32 |
Disallow | */trees |
Disallow | /api* |
Disallow | /ff_* |
Disallow | /review/* |
Disallow | /richrelevance* |
Disallow | *?___store* |
Disallow | *?q* |
Disallow | *?sort* |
Disallow | *?dir* |
Disallow | *?filter* |
Disallow | *?*gclid* |
Disallow | *?utm_* |
Disallow | *?typeSol* |
Disallow | *?vn* |
Disallow | *?msclkid* |
Disallow | *?limit* |
Disallow | *?advisorStatus* |
Disallow | *?design* |
Disallow | *?amp |
Disallow | *childProductCount* |
Disallow | *MobileOptOut* |
Disallow | *LGWCODE* |
Disallow | *?*ds_rl* |
Disallow | *?product= |
Disallow | /quote* |
Disallow | /quickorder* |
Disallow | /quotation* |
Disallow | /customer* |
Disallow | /checkout* |
Disallow | /contacts* |
Disallow | /commander/ |
Disallow | /client/ |
Disallow | /oi/ajax/* |
Disallow | /catalogsearch/* |
Disallow | /catalog/* |
Allow | /catalog/product_ajax/refresh/ |
Allow | /catalog/product_ajax/leadtime?childSku=* |
Allow | /catalog/product_ajax/superconfigurable?* |
bingbot
adidxbot
bingpreview
Rule | Path |
---|---|
Allow | /*.png$ |
Allow | /*.jpg$ |
Allow | /*.gif$ |
Disallow | /video/ajax/product/* |
Disallow | /video/ajax/video/* |
Disallow | */zlib/ |
Disallow | */utils/ |
Disallow | */adler32 |
Disallow | */common$ |
Disallow | */crc32v |
Disallow | */messages |
Disallow | */crc32 |
Disallow | */trees |
Disallow | /api* |
Disallow | /ff_* |
Disallow | /review/* |
Disallow | /richrelevance* |
Disallow | *?___store* |
Disallow | *?q* |
Disallow | *?sort* |
Disallow | *?dir* |
Disallow | *?filter* |
Disallow | *?*gclid* |
Disallow | *?utm_* |
Disallow | *?typeSol* |
Disallow | *?vn* |
Disallow | *?msclkid* |
Disallow | *?limit* |
Disallow | *?advisorStatus* |
Disallow | *?design* |
Disallow | *?amp |
Disallow | *childProductCount* |
Disallow | *MobileOptOut* |
Disallow | *LGWCODE* |
Disallow | *?*ds_rl* |
Disallow | *?product= |
Disallow | /quote* |
Disallow | /quickorder* |
Disallow | /quotation* |
Disallow | /customer* |
Disallow | /checkout* |
Disallow | /contacts* |
Disallow | /commander/ |
Disallow | /client/ |
Disallow | /oi/ajax/* |
Disallow | /catalogsearch/* |
Disallow | /catalog/* |
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google
Rule | Path |
---|---|
Disallow | /checkout* |
Disallow | /catalog/product_ajax/* |
Disallow | /banner/ajax* |
semrushbot
semrushbot-sa
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
ahrefssiteaudit
ahrefsbot
Rule | Path |
---|---|
Disallow | /*? |
Allow | *p%3D |
Disallow | *p%3D*%26* |
Disallow | *%26*p%3D* |
Disallow | /api* |
Disallow | /catalog/* |
Disallow | /catalogsearch/* |
Disallow | /checkout* |
Disallow | /contacts* |
Disallow | /customer* |
Disallow | /ff_* |
Disallow | /quickorder* |
Disallow | /quotation* |
Disallow | /quote* |
Disallow | /review/* |
Disallow | /richrelevance* |
Disallow | /video/ajax/product/* |
Disallow | /video/ajax/video/* |
Disallow | /oi/ajax/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.seton.com/sitemaps/stus/sitemap.xml |
Comments