costway.ca
robots.txt
Robots Exclusion Standard data for costway.ca
Resource Scan
Scan Details
| Site Domain | costway.ca |
| Base Domain | costway.ca |
| Scan Status | Ok |
| Last Scan | 2025-11-08T15:08:05+00:00 |
| Next Scan | 2025-12-08T15:08:05+00:00 |
Last Scan
| Scanned | 2025-11-08T15:08:05+00:00 |
| URL | https://costway.ca/robots.txt |
| Redirect | https://www.costway.ca/robots.txt |
| Redirect Domain | www.costway.ca |
| Redirect Base | costway.ca |
| Domain IPs | 104.26.0.220, 104.26.1.220, 172.67.73.123, 2606:4700:20::681a:1dc, 2606:4700:20::681a:dc, 2606:4700:20::ac43:497b |
| Redirect IPs | 104.26.0.220, 104.26.1.220, 172.67.73.123, 2606:4700:20::681a:1dc, 2606:4700:20::681a:dc, 2606:4700:20::ac43:497b |
| Response IP | 172.67.73.123 |
| Found | Yes |
| Hash | 76349ab359df1dfca962d5a3c91579306c900190e8479c1375c1ea001b07375e |
| SimHash | a43fc843a2f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?keyword=*%5B%5Cu4E00-%5Cu9FA5%5D* |
| Disallow | /captcha/refresh/ |
| Disallow | /hycatalog/product/registration |
| Disallow | /wishlist/ |
| Disallow | /review/product/ |
| Disallow | /ip-security/ |
| Disallow | /cms/index/noCookies/ |
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /faq/list/pagerajax/ |
| Disallow | /paypal/standard/redirect |
| Disallow | /catalog/prizewheel/isLogin |
| Disallow | /*limit%3D |
| Disallow | /*size%3D |
| Disallow | /*price%3D |
| Disallow | /*color_preference%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
| Disallow | /cdn-cgi/. |
| Disallow | /*.pdf$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /search?keyword=*%5B%5Cu4E00-%5Cu9FA5%5D* |
| Disallow | /captcha/refresh/ |
| Disallow | /hycatalog/product/registration |
| Disallow | /wishlist/ |
| Disallow | /review/product/ |
| Disallow | /ip-security/ |
| Disallow | /cms/index/noCookies/ |
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /faq/list/pagerajax/ |
| Disallow | /paypal/standard/redirect |
| Disallow | /catalog/prizewheel/isLogin |
| Disallow | /*limit%3D |
| Disallow | /*price%3D |
| Disallow | /*color_preference%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
| Disallow | /cdn-cgi/. |
| Disallow | /*.pdf$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /search?keyword=*%5B%5Cu4E00-%5Cu9FA5%5D* |
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /*limit%3D |
| Disallow | /*size%3D |
| Disallow | /*price%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
| Disallow | /cdn-cgi/. |
| Disallow | /*.pdf$ |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /media/32000146204.pdf |
| Disallow | /media/3200014718204.pdf |
| Disallow | /media/3200014738204C1.pdf |
| Disallow | /*limit%3D |
| Disallow | /*size%3D |
| Disallow | /*price%3D |
| Disallow | /*utm_medium%3Dsearch |
| Disallow | /*%3Dlive |
| Disallow | /live/ |
| Disallow | /catalogsearch/result/ |
| Disallow | /search?keyword= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.costway.ca/sitemap/sitemap.xml |