c4atreros.es
robots.txt

Robots Exclusion Standard data for c4atreros.es

Resource Scan

Scan Details

Site Domain c4atreros.es
Base Domain c4atreros.es
Scan Status Ok
Last Scan2024-09-27T23:44:26+00:00
Next Scan 2024-10-04T23:44:26+00:00

Last Scan

Scanned2024-09-27T23:44:26+00:00
URL https://c4atreros.es/robots.txt
Response IP 46.4.51.161
Found Yes
Hash ce2ea2fb14f266b927af74bd555341feb1ae95cf3c00df56dfb0fce058aea29d
SimHash 697e4eb56fad

Groups

*

Rule Path
Disallow /trampa/
Disallow /adm/
Disallow /cache/
Disallow /includes/
Disallow /foro/common.php
Disallow /foro/config.php
Disallow /foro/cron.php
Disallow /foro/mcp.php
Disallow /foro/ucp.php
Disallow /foro/report.php
Disallow /foro/viewonline.php
Disallow /foro/posting.php
Disallow /foro/search.php
Disallow /foro/memberlist.php

Other Records

Field Value
crawl-delay 5

psbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Comments

  • 22/01/2023 Bloqueado en los foros, es un acceso muy repetido y pese a que en su web hablan de un buscador distribuido, etc, su actividad real se limita a negociar con información sobre enlaces.
  • 07/02/2023
  • 23/09/2023