stx.com
robots.txt
Robots Exclusion Standard data for stx.com
Resource Scan
Scan Details
Site Domain | stx.com |
Base Domain | stx.com |
Scan Status | Ok |
Last Scan | 2024-05-11T19:10:35+00:00 |
Next Scan | 2024-06-10T19:10:35+00:00 |
Last Scan
Scanned | 2024-05-11T19:10:35+00:00 |
URL | https://stx.com/robots.txt |
Redirect | https://www.stx.com/robots.txt |
Redirect Domain | www.stx.com |
Redirect Base | stx.com |
Domain IPs | 104.26.6.175, 104.26.7.175, 172.67.69.104, 2606:4700:20::681a:6af, 2606:4700:20::681a:7af, 2606:4700:20::ac43:4568 |
Redirect IPs | 104.26.6.175, 104.26.7.175, 172.67.69.104, 2606:4700:20::681a:6af, 2606:4700:20::681a:7af, 2606:4700:20::ac43:4568 |
Response IP | 104.26.6.175 |
Found | Yes |
Hash | e01ff293d68f7555330298e05cf4cc4be4d59bf94354b72bde3e8cf6c46d4ec6 |
SimHash | 28901d23ed44 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php/ |
Disallow | /? |
Disallow | /.js$ |
Disallow | /.css$ |
Disallow | /customer/ |
Disallow | /checkout/ |
Disallow | /js/ |
Disallow | /lib/ |
Disallow | /media/ |
Allow | /media/catalog/product/ |
Disallow | /.php$ |
Disallow | /skin/ |
Disallow | /catalog/product/view/ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /sendfriend/ |
Disallow | /catalogsearch/ |
Disallow | *catalogsearch* |
Disallow | /catalog/ |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.stx.com/sitemaps/sitemap_us.xml |
Comments