gq.com.mx
robots.txt

Robots Exclusion Standard data for gq.com.mx

Resource Scan

Scan Details

Site Domain gq.com.mx
Base Domain gq.com.mx
Scan Status Ok
Last Scan2024-05-24T19:25:18+00:00
Next Scan 2024-05-31T19:25:18+00:00

Last Scan

Scanned2024-05-24T19:25:18+00:00
URL https://gq.com.mx/robots.txt
Redirect https://www.gq.com.mx/robots.txt
Redirect Domain www.gq.com.mx
Redirect Base gq.com.mx
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 108.157.254.128, 108.157.254.39, 108.157.254.72, 108.157.254.85, 2600:9000:2753:6800:10:608f:d700:93a1, 2600:9000:2753:6a00:10:608f:d700:93a1, 2600:9000:2753:8400:10:608f:d700:93a1, 2600:9000:2753:ce00:10:608f:d700:93a1, 2600:9000:2753:d600:10:608f:d700:93a1, 2600:9000:2753:de00:10:608f:d700:93a1, 2600:9000:2753:ec00:10:608f:d700:93a1, 2600:9000:2753:f400:10:608f:d700:93a1
Response IP 108.157.254.39
Found Yes
Hash 96ff8df14f5b874ca90fae9fe0086d4c69c9aed0d6de02d0993b9518f01b83b2
SimHash 0c148161e311

Groups

*

Rule Path
Disallow */fullscreen/*/publicidad
Disallow /vote
Disallow *.shtml
Disallow */5574/mx.n5574*
Disallow /preview/
Disallow /*?image=
Disallow */image/
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gq.com.mx/sitemap.xml
sitemap https://www.gq.com.mx/feed/sitemap-news/sitemap-google-news
sitemap https://www.gq.com.mx/feed/rss
sitemap https://www.gq.com.mx/categories-sitemap.xml
sitemap https://www.gq.com.mx/contributors-sitemap.xml
sitemap https://www.gq.com.mx/branded-sitemap.xml
sitemap https://www.gq.com.mx/bundles-sitemap.xml