complex.com
robots.txt
Robots Exclusion Standard data for complex.com
Resource Scan
Scan Details
| Site Domain | complex.com |
| Base Domain | complex.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T04:24:24+00:00 |
| Next Scan | 2024-09-28T04:24:24+00:00 |
Last Scan
| Scanned | 2024-09-21T04:24:24+00:00 |
| URL | https://complex.com/robots.txt |
| Redirect | https://www.complex.com/robots.txt |
| Redirect Domain | www.complex.com |
| Redirect Base | complex.com |
| Domain IPs | 13.227.254.109, 13.227.254.27, 13.227.254.93, 13.227.254.94 |
| Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Response IP | 199.232.46.133 |
| Found | Yes |
| Hash | 1d52a41801f260f414c5d9cfd39e28480e0e98be564fa738197d36b85aac3815 |
| SimHash | c92a5f7548d9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /core/ |
| Disallow | /dex/ |
| Disallow | /cgi-bin/ |
| Disallow | /includes/ |
| Disallow | /plugins/ |
| Disallow | /system/ |
| Disallow | /widgets/ |
| Disallow | /assets/ |
| Disallow | /api/ |
| Disallow | /static/js/ |
| Disallow | /static/css/ |
| Disallow | /js/ |
| Disallow | /css/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.complex.com/sitemap/v3/index.xml |
| sitemap | https://www.complex.com/sitemap/v3/articles.xml |
| sitemap | https://www.complex.com/sitemap/v3/tags.xml |
| sitemap | https://www.complex.com/sitemap/v3/authors.xml |
| sitemap | https://www.complex.com/sitemap/v3/videos.xml |