callejero.eu
robots.txt

Robots Exclusion Standard data for callejero.eu

Resource Scan

Scan Details

Site Domain callejero.eu
Base Domain callejero.eu
Scan Status Ok
Last Scan2024-09-25T19:11:34+00:00
Next Scan 2024-10-02T19:11:34+00:00

Last Scan

Scanned2024-09-25T19:11:34+00:00
URL https://callejero.eu/robots.txt
Domain IPs 209.42.192.171
Response IP 209.42.192.171
Found Yes
Hash a38e49826b90d0fdbdeb9e4e97862078ae0d6f25756762f02737eb245ddd77d2
SimHash a24874c208bc

Groups

*

Rule Path
Disallow contacto.php
Disallow aviso-legal.php
Disallow /foro/
Disallow /mobile/
Disallow /android/
Disallow /editor/
Disallow /cgi-bin/
Disallow cookies.php
Disallow coordenadas.php
Disallow flickr2.php*
Disallow cabecera.php
Disallow cordes.php
Disallow pie.php
Disallow piemunicipio.php
Disallow cabeceramunicipio.php
Disallow bucadormapa.php
Disallow login.php
Disallow aviso-legal.php
Disallow recaptchalib.php
Disallow activate.php
Disallow admin.php
Disallow checkuser.php
Disallow dbc.php
Disallow do.php
Disallow error_log
Disallow forgot.php
Disallow logout.php
Disallow myaccount.php
Disallow mysettings.php
Disallow register.php
Disallow thankyou.php
Disallow telegram.php
Disallow flickr2.php
Disallow cookies.php
Disallow directorio-empresas.php
Disallow lasempresas.php
Disallow reportar.php
Disallow cookies.php

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30