gqmagazine.fr
robots.txt

Robots Exclusion Standard data for gqmagazine.fr

Resource Scan

Scan Details

Site Domain gqmagazine.fr
Base Domain gqmagazine.fr
Scan Status Ok
Last Scan2024-09-21T18:01:18+00:00
Next Scan 2024-09-28T18:01:18+00:00

Last Scan

Scanned2024-09-21T18:01:18+00:00
URL https://gqmagazine.fr/robots.txt
Redirect https://www.gqmagazine.fr/robots.txt
Redirect Domain www.gqmagazine.fr
Redirect Base gqmagazine.fr
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 13.33.30.107, 13.33.30.118, 13.33.30.19, 13.33.30.7, 2600:9000:229f:1a00:1a:9a64:8780:93a1, 2600:9000:229f:2800:1a:9a64:8780:93a1, 2600:9000:229f:3800:1a:9a64:8780:93a1, 2600:9000:229f:7200:1a:9a64:8780:93a1, 2600:9000:229f:a800:1a:9a64:8780:93a1, 2600:9000:229f:c600:1a:9a64:8780:93a1, 2600:9000:229f:d400:1a:9a64:8780:93a1, 2600:9000:229f:e000:1a:9a64:8780:93a1
Response IP 13.33.30.19
Found Yes
Hash 320f94ec9bf630a37f2deb6e78521324694af952f07d4c90bcfe383e0cc0dd39
SimHash 05118171e773

Groups

*

Rule Path
Disallow /recherche
Disallow /search
Disallow /app_dev*
Disallow /test
Disallow /concours
Disallow */plein-ecran
Disallow /5574/FR-GQ/
Disallow */image/
Disallow /embed/
Disallow /5574/FR-New-GQ/
Disallow /5574/FR-GQ-Mobile/
Disallow /preview/
Disallow *?image=
Disallow */image/
Disallow /club-gq/*
Disallow /*?redirectURL=
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gqmagazine.fr/sitemap.xml
sitemap https://www.gqmagazine.fr/feed/rss
sitemap https://www.gqmagazine.fr/feed/articles/sitemap-google-news
sitemap https://www.gqmagazine.fr/branded-sitemap.xml
sitemap https://www.gqmagazine.fr/categories-sitemap.xml
sitemap https://www.gqmagazine.fr/contributors-sitemap.xml
sitemap https://www.gqmagazine.fr/bundles-sitemap.xml