grana-shop.fr
robots.txt

Robots Exclusion Standard data for grana-shop.fr

Resource Scan

Scan Details

Site Domain grana-shop.fr
Base Domain grana-shop.fr
Scan Status Ok
Last Scan2024-05-16T15:44:49+00:00
Next Scan 2024-06-15T15:44:49+00:00

Last Scan

Scanned2024-05-16T15:44:49+00:00
URL https://grana-shop.fr/robots.txt
Redirect https://www.grana-shop.fr/robots.txt
Redirect Domain www.grana-shop.fr
Redirect Base grana-shop.fr
Domain IPs 35.187.101.34
Redirect IPs 35.187.101.34
Response IP 35.187.101.34
Found Yes
Hash 16b24ab1ee1163f43463e8ef2a93879bfb458fbdda74bcb6126e346e2a3b2223
SimHash 7076d3c0d029

Groups

*

Rule Path
Disallow /

googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
mediapartners-google
adsbot-google
adsbot-google-mobile-apps

Rule Path
Disallow /wp-admin/
Disallow */attachment/*
Disallow */author/*
Disallow */*author%3D*
Disallow */*attachment_id%3D*
Allow /wp-admin/admin-ajax.php

screaming frog seo spider
orangebot
twitterbot
qwantify
applebot
applenewsbot
pinterestbot
pinterest
dotbot
mj12bot
feedly
duckduckbot
duckduckgo-favicons-bot
yandex
yandexmobilebot
slurp
facebookcatalog
facebookexternalhit
facebot
linkedinbot
bingbot
bingpreview
msnbot
msnbot-media
adidxbot

Rule Path
Disallow /wp-admin/
Disallow */attachment/*
Disallow */author/*
Disallow */*author%3D*
Disallow */*attachment_id%3D*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Comments

  • block all robots
  • google
  • Google image
  • Google Mobile
  • Google News
  • Goole videos
  • Google Adsense
  • Google Adwords
  • Google Adwords mobile apps
  • SemRush
  • User-agent: SemrushBot
  • User-agent: SemrushBot-SA
  • Screaming Frog
  • Orange
  • Twitter
  • Qwant
  • Apple
  • pinterest
  • MOZ
  • Majestic SEO
  • Ahrefs
  • User-agent: AhrefsBot
  • Feedly
  • DuckDuckGo
  • yandex
  • yahoo
  • facebook ads
  • LinkedIn
  • bing
  • bing preview
  • Bing Msn
  • bing Msn images&video
  • bing ads