arica.evisos.cl
robots.txt

Robots Exclusion Standard data for arica.evisos.cl

Resource Scan

Scan Details

Site Domain arica.evisos.cl
Base Domain evisos.cl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-10T03:58:05+00:00
Next Scan 2025-01-08T03:58:05+00:00

Last Successful Scan

Scanned2024-05-21T03:56:28+00:00
URL https://arica.evisos.cl/robots.txt
Domain IPs 104.26.0.53, 104.26.1.53, 172.67.70.110, 2606:4700:20::681a:135, 2606:4700:20::681a:35, 2606:4700:20::ac43:466e
Response IP 104.26.1.53
Found Yes
Hash 18f4130f180e1e5c1b1b80d0e7fe332edf16f1b30edbb3b97e48954e4c6ff593
SimHash 405deca3c619

Groups

googlebot

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

googlebot-image

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

*

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Allow /ajax/static_blocks

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yadirectbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

badbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

applebot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

voilabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Comments

  • User-agent: MJ12bot
  • disallow: /
  • User-agent: ia_archiver
  • Disallow: /