Log In Sign Up

vigilance.fr
robots.txt

Robots Exclusion Standard data for vigilance.fr

Resource Scan

Scan Details

Site Domain vigilance.fr
Base Domain vigilance.fr
Scan Status Ok
Last Scan2024-10-15T20:35:42+00:00
Next Scan 2024-11-14T20:35:42+00:00

Last Scan

Scanned2024-10-15T20:35:42+00:00
URL https://vigilance.fr/robots.txt
Domain IPs 90.84.246.161
Response IP 90.84.246.161
Found Yes
Hash 93f50fd040f0d5c6a04e76ad129bdb944611732c10da9faaf7c441593de76260
SimHash 731cc950ac82

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

buck

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

feedly

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

friendly_crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

fluid

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

owleyes

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

udu

Rule Path
Disallow /

um-ln

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

*

Rule Path
Disallow /doc/
Disallow /arbre/
Disallow /tree/
Disallow /subscriber
Disallow /abonne

Other Records

Field Value
crawl-delay 90
Back to top

Other Records

Field Value
sitemap https://vigilance.fr/sitemap
Back to top

Comments

  • Par défaut.
  • Sitemap.
Back to top