gqmagazine.fr
robots.txt

Robots Exclusion Standard data for gqmagazine.fr

Resource Scan

Scan Details

Site Domain gqmagazine.fr
Base Domain gqmagazine.fr
Scan Status Ok
Last Scan2024-11-09T19:51:02+00:00
Next Scan 2024-11-16T19:51:02+00:00

Last Scan

Scanned2024-11-09T19:51:02+00:00
URL https://gqmagazine.fr/robots.txt
Redirect https://www.gqmagazine.fr/robots.txt
Redirect Domain www.gqmagazine.fr
Redirect Base gqmagazine.fr
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 13.33.88.109, 13.33.88.31, 13.33.88.40, 13.33.88.69, 2600:9000:223b:2200:1a:9a64:8780:93a1, 2600:9000:223b:9800:1a:9a64:8780:93a1, 2600:9000:223b:9e00:1a:9a64:8780:93a1, 2600:9000:223b:bc00:1a:9a64:8780:93a1, 2600:9000:223b:c800:1a:9a64:8780:93a1, 2600:9000:223b:d600:1a:9a64:8780:93a1, 2600:9000:223b:e200:1a:9a64:8780:93a1, 2600:9000:223b:f800:1a:9a64:8780:93a1
Response IP 13.33.88.109
Found Yes
Hash b922095976983c5279f674335b7bbd68e24a37545066b67ca48c8958e5c35e2d
SimHash 25118171e773

Groups

*

Rule Path
Disallow /recherche
Disallow /search
Disallow /app_dev*
Disallow /test
Disallow /concours
Disallow */plein-ecran
Disallow /5574/FR-GQ/
Disallow */image/
Disallow /embed/
Disallow /5574/FR-New-GQ/
Disallow /5574/FR-GQ-Mobile/
Disallow /preview/
Disallow *?image=
Disallow */image/
Disallow /club-gq/*
Disallow /*?redirectURL=
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=
Disallow /com.condenast/yv8*

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gqmagazine.fr/sitemap.xml
sitemap https://www.gqmagazine.fr/feed/rss
sitemap https://www.gqmagazine.fr/feed/articles/sitemap-google-news
sitemap https://www.gqmagazine.fr/branded-sitemap.xml
sitemap https://www.gqmagazine.fr/categories-sitemap.xml
sitemap https://www.gqmagazine.fr/contributors-sitemap.xml
sitemap https://www.gqmagazine.fr/bundles-sitemap.xml