biblio.es
robots.txt

Robots Exclusion Standard data for biblio.es

Resource Scan

Scan Details

Site Domain biblio.es
Base Domain biblio.es
Scan Status Ok
Last Scan2024-09-28T20:12:33+00:00
Next Scan 2024-10-05T20:12:33+00:00

Last Scan

Scanned2024-09-28T20:12:33+00:00
URL https://biblio.es/robots.txt
Domain IPs 104.26.0.173, 104.26.1.173, 172.67.68.218, 2606:4700:20::681a:1ad, 2606:4700:20::681a:ad, 2606:4700:20::ac43:44da
Response IP 104.26.0.173
Found Yes
Hash ac7482e045991f321e5b85bd799d3e20491412a29c7bddd47d737bf79933090e
SimHash 42dd5f615659

Groups

*

Rule Path
Disallow /abrowse.php
Disallow /account_menu.php
Disallow /booksellers/
Disallow /app/booksellers/
Disallow /add_rental_to_cart.php
Disallow /app/jaxie/find_prices
Disallow /app/jaxie/meta_search
Disallow /app/offer/make
Disallow /b/
Disallow /banner.php
Disallow /bgsearch.php
Disallow /bookhounddownload/
Disallow /book_photos/
Disallow /browse_catalogs/
Disallow /buscar
Disallow /cart.php
Disallow /create_account.php
Disallow /ebooks/
Disallow /email_listing.php
Disallow /favorite_booksellers.php
Disallow /info_request.php
Disallow /login.php
Disallow /login
Disallow /m/
Disallow /map.php
Disallow /o/
Disallow /omit/
Disallow /orderdetails.php
Disallow /print-on-demand/
Disallow /remote-search*
Disallow /rental_search.php
Disallow /review.php
Disallow /search.php
Disallow /secure-checkout/
Disallow /selling_books/account_registration.php
Disallow /shipping_estimate.php
Disallow /submit_recommendation.php
Disallow /utility/
Disallow /w/
Disallow /wants.php
Disallow /z/

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

boitho.com-dc

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

crawlbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

speedy

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /