gq.com.mx
robots.txt
Robots Exclusion Standard data for gq.com.mx
Resource Scan
Scan Details
Site Domain | gq.com.mx |
Base Domain | gq.com.mx |
Scan Status | Ok |
Last Scan | 2024-05-24T19:25:18+00:00 |
Next Scan | 2024-05-31T19:25:18+00:00 |
Last Scan
Scanned | 2024-05-24T19:25:18+00:00 |
URL | https://gq.com.mx/robots.txt |
Redirect | https://www.gq.com.mx/robots.txt |
Redirect Domain | www.gq.com.mx |
Redirect Base | gq.com.mx |
Domain IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
Redirect IPs | 108.157.254.128, 108.157.254.39, 108.157.254.72, 108.157.254.85, 2600:9000:2753:6800:10:608f:d700:93a1, 2600:9000:2753:6a00:10:608f:d700:93a1, 2600:9000:2753:8400:10:608f:d700:93a1, 2600:9000:2753:ce00:10:608f:d700:93a1, 2600:9000:2753:d600:10:608f:d700:93a1, 2600:9000:2753:de00:10:608f:d700:93a1, 2600:9000:2753:ec00:10:608f:d700:93a1, 2600:9000:2753:f400:10:608f:d700:93a1 |
Response IP | 108.157.254.39 |
Found | Yes |
Hash | 96ff8df14f5b874ca90fae9fe0086d4c69c9aed0d6de02d0993b9518f01b83b2 |
SimHash | 0c148161e311 |
Groups
*
Rule | Path |
---|---|
Disallow | */fullscreen/*/publicidad |
Disallow | /vote |
Disallow | *.shtml |
Disallow | */5574/mx.n5574* |
Disallow | /preview/ |
Disallow | /*?image= |
Disallow | */image/ |
Disallow | /*%7B%7Burl%7D%7D |
Disallow | /*%7B%7Burl%7D%7D |
Disallow | /*%7B%7Bsection%7D%7D |
Disallow | /*%7B%7Bsection%7D%7D |
Disallow | /auth/* |
Disallow | /account/* |
Disallow | /product/ |
Disallow | /user-context?referrer |
Disallow | /services.min.js?_= |
Other Records
Field | Value |
---|---|
sitemap | https://www.gq.com.mx/sitemap.xml |
sitemap | https://www.gq.com.mx/feed/sitemap-news/sitemap-google-news |
sitemap | https://www.gq.com.mx/feed/rss |
sitemap | https://www.gq.com.mx/categories-sitemap.xml |
sitemap | https://www.gq.com.mx/contributors-sitemap.xml |
sitemap | https://www.gq.com.mx/branded-sitemap.xml |
sitemap | https://www.gq.com.mx/bundles-sitemap.xml |