ca.complex.com
robots.txt
Robots Exclusion Standard data for ca.complex.com
Resource Scan
Scan Details
| Site Domain | ca.complex.com |
| Base Domain | complex.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-07T02:42:02+00:00 |
| Next Scan | 2026-01-21T02:42:02+00:00 |
Last Successful Scan
| Scanned | 2025-12-16T02:41:18+00:00 |
| URL | https://ca.complex.com/robots.txt |
| Redirect | https://www.complex.com/robots.txt |
| Redirect Domain | www.complex.com |
| Redirect Base | complex.com |
| Domain IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Response IP | 199.232.114.133 |
| Found | Yes |
| Hash | f59fa483c4696291ef86a1fc90eadba1e40518de0099f0efd341465d0fc7ac88 |
| SimHash | dc3105542c20 |
Groups
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /checkouts/ |
| Disallow | /checkout |
| Disallow | /carts |
| Disallow | /orders |
| Disallow | /63826591966/checkouts |
| Disallow | /63826591966/orders |
| Disallow | /*?*oseid=* |
| Disallow | /*preview_theme_id* |
| Disallow | /*preview_script_id* |
ahrefssiteaudit
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /cart |
| Disallow | /orders |
| Disallow | /checkouts/ |
| Disallow | /checkout |
| Disallow | /63826591966/checkouts |
| Disallow | /63826591966/orders |
| Disallow | /carts |
| Disallow | /account |
| Disallow | /blogs/*%2B* |
| Disallow | /blogs/*%2B* |
| Disallow | /blogs/*%2B* |
| Disallow | /*/blogs/*%2B* |
| Disallow | /*/blogs/*%2B* |
| Disallow | /*/blogs/*%2B* |
| Disallow | /*?*oseid=* |
| Disallow | /*preview_theme_id* |
| Disallow | /*preview_script_id* |
| Disallow | /policies/ |
| Disallow | /*/*?*ls=*&ls=* |
| Disallow | /*/*?*ls%3D*%3Fls%3D* |
| Disallow | /*/*?*ls%3D*%3Fls%3D* |
| Disallow | /search |
| Allow | /search/ |
| Disallow | /search/?* |
| Disallow | /apple-app-site-association |
| Disallow | /.well-known/shopify/monorail |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /*?*direction= |
| Disallow | /*?*cursor= |
| Disallow | /*?*jw_start= |
| Disallow | /*?*Size= |
| Disallow | /*?*dropID= |
| Disallow | /*?*Material= |
| Disallow | /*?*queryId= |
| Disallow | /core/ |
| Disallow | /dex/ |
| Disallow | /cgi-bin/ |
| Disallow | /includes/ |
| Disallow | /flash/ |
| Disallow | /plugins/ |
| Disallow | /system/ |
| Disallow | /widgets/ |
| Disallow | /assets/ |
| Disallow | /blogs/wp-content/ |
| Disallow | /blog-galleries/ |
| Disallow | /blogs/ |
| Disallow | /api/ |
| Disallow | /static/js/ |
| Disallow | /static/css/ |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /tv/ |
| Disallow | /search?* |
| Disallow | /admin |
| Disallow | /cart |
| Disallow | /orders |
| Disallow | /checkouts/ |
| Disallow | /checkout |
| Disallow | /63826591966/checkouts |
| Disallow | /63826591966/orders |
| Disallow | /carts |
| Disallow | /account |
| Disallow | /blogs/*%2B* |
| Disallow | /blogs/*%2B* |
| Disallow | /blogs/*%2B* |
| Disallow | /*/blogs/*%2B* |
| Disallow | /*/blogs/*%2B* |
| Disallow | /*/blogs/*%2B* |
| Disallow | /*?*oseid=* |
| Disallow | /*preview_theme_id* |
| Disallow | /*preview_script_id* |
| Disallow | /policies/ |
| Disallow | /*/*?*ls=*&ls=* |
| Disallow | /*/*?*ls%3D*%3Fls%3D* |
| Disallow | /*/*?*ls%3D*%3Fls%3D* |
| Disallow | /search |
| Allow | /search/ |
| Disallow | /search/?* |
| Disallow | /apple-app-site-association |
| Disallow | /.well-known/shopify/monorail |
| Disallow | /shop/drops/takashi-murakami-mlb-tokyo-series-2025 |
| Allow | /sitemap/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.complex.com/shop/sitemap.xml |
| sitemap | https://www.complex.com/sitemap/v3/news.xml |
| sitemap | https://www.complex.com/sitemap/v3/articles.xml |
| sitemap | https://www.complex.com/sitemap/v3/videos.xml |
| sitemap | https://www.complex.com/sitemap/v3/pages.xml |
| sitemap | https://www.complex.com/sitemap/v3/tags.xml |
| sitemap | https://www.complex.com/sitemap/v3/authors.xml |
| sitemap | https://www.complex.com/sitemap/v3/index.xml |
Comments