Log In Sign Up

revolutionpermanente.fr
robots.txt

Robots Exclusion Standard data for revolutionpermanente.fr

Resource Scan

Scan Details

Site Domain revolutionpermanente.fr
Base Domain revolutionpermanente.fr
Scan Status Ok
Last Scan2024-05-23T05:23:41+00:00
Next Scan 2024-06-22T05:23:41+00:00

Last Scan

Scanned2024-05-23T05:23:41+00:00
URL https://revolutionpermanente.fr/robots.txt
Domain IPs 104.22.64.91, 104.22.65.91, 172.67.39.171, 2606:4700:10::6816:405b, 2606:4700:10::6816:415b, 2606:4700:10::ac43:27ab
Response IP 172.67.39.171
Found Yes
Hash 987fded21588048641f3658633e04278cd4a1639b56c04736a30aa1ef3c57c9f
SimHash f89072d24a20

Groups

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semantic-visions.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /ecrire/

*

Rule Path
Allow /
Back to top

Comments

  • Bloqueo completo de varios bots
  • Si algún bloqueo llegara a no funcionar, se puede usar .htacces:
  • https://cleantalk.org/help/blocking-bots-by-ua
  • Otro listado similar:
  • https://gist.github.com/demyanovs/e5a1ac424e62ce01641bcc95afe0564c
  • AhrefsBot: https://ahrefs.com/robot/
  • AhrefsSiteAudit: https://ahrefs.com/robot/site-audit
  • BLP_bbot: https://lyte.id.au/2010/02/04/wtf-is-blp_bbot/
  • DataForSeoBot: https://dataforseo.com/dataforseo-bot
  • dotbot: https://opensiteexplorer.org/dotbot
  • MegaIndex: https://megaindex.com/crawler
  • Omgilibot: http://omgili.com/crawler.html
  • PetalBot: https://webmaster.petalsearch.com/site/petalbot
  • semantic-visions
  • SemrushBot: https://www.semrush.com/bot/
  • sentibot: https://www.sentibot.eu
  • TurnitinBot: https://www.turnitin.com/robot/crawlerinfo.html
  • Yandex: https://yandex.com/support/webmaster/robot-workings/robot.html
  • Bloqueamos el acceso de cualquier robot a /ecrire/
  • El resto de los robots está permitido
Back to top