guiasjuridicas.laley.es
robots.txt

Robots Exclusion Standard data for guiasjuridicas.laley.es

Resource Scan

Scan Details

Site Domain guiasjuridicas.laley.es
Base Domain laley.es
Scan Status Ok
Last Scan2024-10-22T11:17:41+00:00
Next Scan 2024-11-21T11:17:41+00:00

Last Scan

Scanned2024-10-22T11:17:41+00:00
URL https://guiasjuridicas.laley.es/robots.txt
Domain IPs 13.107.253.59, 2620:1ec:29:1::59
Response IP 13.107.246.57
Found Yes
Hash 657c0c82078b10e39f2d58c048af06ec5dff907a7ab030856f277e2fb3d6201b
SimHash 2e15539ed579

Groups

ia_archiver

Rule Path
Disallow

slurp

Rule Path
Disallow

abachobot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

fireball

Rule Path
Disallow

objectssearch

Rule Path
Disallow

szukacz

Rule Path
Disallow

voilabot

Rule Path
Disallow

appie

Rule Path
Disallow

yandex

Rule Path
Disallow

googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
adsbot-google-mobile-apps
adsbot-google
mediapartners-google
bingbot
bingpreview
msnbot
msnbot-media
adidxbot
applebot
applenewsbot
teoma
duckduckbot
duckduckgo-favicons-bot
lycos
orangebot
qwantify
slurp
facebot
linkedinbot
twitterbot
pinterest
ccbot
dazoobot
euripbot
feedly
findxbot
netvibes
wotbox
yioopbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://guiasjuridicas.laley.es/sitemaps/sitemap.xml

Comments

  • Alexa
  • Yahoo!
  • Abacho
  • Baidu
  • Fireball
  • ObjectsSearch
  • Szukacz
  • Voila.fr
  • Walhello
  • Yandex