libri.hu
robots.txt

Robots Exclusion Standard data for libri.hu

Resource Scan

Scan Details

Site Domain libri.hu
Base Domain libri.hu
Scan Status Ok
Last Scan2024-09-28T21:24:59+00:00
Next Scan 2024-10-05T21:24:59+00:00

Last Scan

Scanned2024-09-28T21:24:59+00:00
URL https://libri.hu/robots.txt
Redirect https://www.libri.hu/robots.txt
Redirect Domain www.libri.hu
Redirect Base libri.hu
Domain IPs 212.52.164.111, 212.52.164.112, 213.181.220.73, 213.181.220.74
Redirect IPs 212.52.164.111, 212.52.164.112, 213.181.220.73, 213.181.220.74
Response IP 213.181.220.73
Found Yes
Hash 45d6f2d1db489adea73daefde760d6e7fc2b2a49272e1b5e0f38dbe6fd422e2d
SimHash 2344951fc057

Groups

*

Rule Path
Disallow /adataim/
Disallow /kivansaglista/
Disallow /shop_cart/
Disallow /libri/
Disallow /libri/intranet/
Disallow /order/
Disallow /ajax/
Disallow /gravity/
Disallow /my_orders/
Disallow /registration/
Disallow /adataim/
Disallow /hu/subscribe/
Disallow /hu/unsubscribe/
Disallow /hu/reminder/
Disallow /partner_oldalak/a_program_leirasa/
Disallow /partner_oldalak/bannerek/
Disallow /partner_oldalak/napi_forgalom/
Disallow /partner_oldalak/forgalom_termek/
Disallow /partner_oldalak/folyoszamla/
Disallow /partner_oldalak/vasarlasi_hajlandosag/
Disallow /partner_oldalak/regisztracio/
Disallow /book_file/
Disallow /hibak/
Disallow /captcha/
Disallow /export/
Disallow /js/
Disallow /kupon/
Disallow /mail/
Disallow /p_banners/
Disallow /ws/
Disallow /xml/
Disallow /download/
Disallow /download.cmt
Disallow /download_file.cmt
Disallow /hu/images/
Disallow /libri_kalandtabor/
Disallow /egyeb/libri-kalandtabor-1.html
Disallow /egyeb/kalandtabor-elso-reszlet.html
Disallow /egyeb/kalandtabor-masodik-reszlet.html
Disallow /cgi-bin/*
Disallow /en/
Disallow /idegen_nyelvu/
Disallow /talalati_lista/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10