biblio.com
robots.txt

Robots Exclusion Standard data for biblio.com

Resource Scan

Scan Details

Site Domain biblio.com
Base Domain biblio.com
Scan Status Ok
Last Scan2024-11-13T22:42:00+00:00
Next Scan 2024-11-14T22:42:00+00:00

Last Scan

Scanned2024-11-13T22:42:00+00:00
URL https://biblio.com/robots.txt
Redirect https://www.biblio.com/robots.txt
Redirect Domain www.biblio.com
Redirect Base biblio.com
Domain IPs 104.26.12.161, 104.26.13.161, 172.67.71.175, 2606:4700:20::681a:ca1, 2606:4700:20::681a:da1, 2606:4700:20::ac43:47af
Redirect IPs 104.26.12.161, 104.26.13.161, 172.67.71.175, 2606:4700:20::681a:ca1, 2606:4700:20::681a:da1, 2606:4700:20::ac43:47af
Response IP 172.67.71.175
Found Yes
Hash 7fd09455a4eee224e90950cd637fa104458dfb7818a76083eedd84ad1c36c6d2
SimHash 429c5e611e59

Groups

*

Rule Path
Disallow /abrowse.php
Disallow /account_menu.php
Disallow /booksellers/
Disallow /app/booksellers/
Disallow /add_rental_to_cart.php
Disallow /app/jaxie/find_prices
Disallow /app/jaxie/meta_search
Disallow /app/offer/make
Disallow /b/
Disallow /banner.php
Disallow /bgsearch.php
Disallow /bookhounddownload/
Disallow /book_photos/
Disallow /browse_catalogs/
Disallow /cart.php
Disallow /create_account.php
Disallow /ebooks/
Disallow /email_listing.php
Disallow /favorite_booksellers.php
Disallow /info_request.php
Disallow /login.php
Disallow /login
Disallow /m/
Disallow /map.php
Disallow /o/
Disallow /omit/
Disallow /orderdetails.php
Disallow /print-on-demand/
Disallow /remote-search*
Disallow /rental_search.php
Disallow /review.php
Disallow /search.php
Disallow /secure-checkout/
Disallow /selling_books/account_registration.php
Disallow /shipping_estimate.php
Disallow /submit_recommendation.php
Disallow /utility/
Disallow /w/
Disallow /wants.php
Disallow /z/

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

boitho.com-dc

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

crawlbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

speedy

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.biblio.com/blog/sitemap_index.xml