costway.com
robots.txt
Robots Exclusion Standard data for costway.com
Resource Scan
Scan Details
| Site Domain | costway.com |
| Base Domain | costway.com |
| Scan Status | Ok |
| Last Scan | 2025-11-10T15:11:41+00:00 |
| Next Scan | 2025-12-10T15:11:41+00:00 |
Last Scan
| Scanned | 2025-11-10T15:11:41+00:00 |
| URL | https://costway.com/robots.txt |
| Redirect | https://www.costway.com/robots.txt |
| Redirect Domain | www.costway.com |
| Redirect Base | costway.com |
| Domain IPs | 104.20.25.58, 172.66.154.74, 2606:4700:10::6814:193a, 2606:4700:10::ac42:9a4a |
| Redirect IPs | 104.20.25.58, 172.66.154.74, 2606:4700:10::6814:193a, 2606:4700:10::ac42:9a4a |
| Response IP | 104.20.25.58 |
| Found | Yes |
| Hash | f85b7fcc925a70b89781712122dac0685f695658982b9e9bb708929c1c08f99d |
| SimHash | a43fc843a2f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?keyword=*%5B%5Cu4E00-%5Cu9FA5%5D* |
| Disallow | /captcha/refresh/ |
| Disallow | /hycatalog/product/registration |
| Disallow | /wishlist/ |
| Disallow | /review/product/ |
| Disallow | /ip-security/ |
| Disallow | /cms/index/noCookies/ |
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /faq/list/pagerajax/ |
| Disallow | /paypal/standard/redirect |
| Disallow | /catalog/prizewheel/isLogin |
| Disallow | /*limit%3D |
| Disallow | /*size%3D |
| Disallow | /*price%3D |
| Disallow | /*color_preference%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
| Disallow | /cdn-cgi/. |
| Disallow | /*.pdf$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /search?keyword=*%5B%5Cu4E00-%5Cu9FA5%5D* |
| Disallow | /captcha/refresh/ |
| Disallow | /hycatalog/product/registration |
| Disallow | /wishlist/ |
| Disallow | /review/product/ |
| Disallow | /ip-security/ |
| Disallow | /cms/index/noCookies/ |
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /faq/list/pagerajax/ |
| Disallow | /paypal/standard/redirect |
| Disallow | /catalog/prizewheel/isLogin |
| Disallow | /*limit%3D |
| Disallow | /*price%3D |
| Disallow | /*color_preference%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
| Disallow | /cdn-cgi/. |
| Disallow | /*.pdf$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /search?keyword=*%5B%5Cu4E00-%5Cu9FA5%5D* |
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /*limit%3D |
| Disallow | /*price%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
| Disallow | /cdn-cgi/. |
| Disallow | /*.pdf$ |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /*limit%3D |
| Disallow | /*size%3D |
| Disallow | /*price%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.costway.com/sitemap/sitemap.xml |
Comments