generation-nt.com
robots.txt

Robots Exclusion Standard data for generation-nt.com

Resource Scan

Scan Details

Site Domain generation-nt.com
Base Domain generation-nt.com
Scan Status Ok
Last Scan2024-05-30T19:28:13+00:00
Next Scan 2024-06-06T19:28:13+00:00

Last Scan

Scanned2024-05-30T19:28:13+00:00
URL https://generation-nt.com/robots.txt
Redirect https://www.generation-nt.com/robots.txt
Redirect Domain www.generation-nt.com
Redirect Base generation-nt.com
Domain IPs 51.178.73.217
Redirect IPs 51.178.73.217
Response IP 51.178.73.217
Found Yes
Hash 76d7363d62f03e0c74c1fdca66d94404069f1337164eed57e6c8b5cbae803b7f
SimHash 6b4d5842fe13

Groups

amazonbot

Rule Path
Disallow /reponses/

yandexbot

Rule Path
Disallow /reponses/

applewebkit

Rule Path
Disallow /reponses/

bingbot

Rule Path
Disallow /entraide-recherche/

gptbot

Rule Path
Disallow /

yaanibot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /imprimer/
Disallow /membres/
Disallow /s/
Disallow /entraide-recherche/
Disallow /go/
Disallow /inc/ads/
Disallow /inc/pub/
Disallow /comparateur/
Disallow /previsualiser/
Disallow /envoyer/
Disallow /information/
Disallow /contacts.html
Disallow /habillage.html
Disallow /divers/
Disallow /acheter/*?go=*
Disallow /acheter/*?o=*
Disallow /us/
Disallow /follow*
Disallow /stats-reponses*
Disallow /stats-item*
Disallow /stats-commentaire*
Disallow /stats-video-commentaire*
Disallow /zoom-%28%5B0-9%5D%2B%29%2C%28%5B0-9%5D%2B%29-%28%5Ba-z0-9%5C-%5D%2B%29.html$
Disallow /zoom-%28%5B0-9%5D%2B%29%2C%28%5B0-9%5D%2B%29%2C%28%5B0-9%5D%2B%29-%28%5Ba-z0-9%5C-%5D%2B%29.html$
Disallow /*?ixvtco$
Disallow /*?ixvtco&*
Disallow /*%26ixvtco$
Disallow /*%26ixvtco%26*

Other Records

Field Value
sitemap https://www.generation-nt.com/sitemap.xml
sitemap https://www.generation-nt.com/sitemap_entraides.xml

Comments

  • User-agent: bingbot
  • Crawl-delay: 1
  • SEO indexer