biblio.sg
robots.txt

Robots Exclusion Standard data for biblio.sg

Resource Scan

Scan Details

Site Domain biblio.sg
Base Domain biblio.sg
Scan Status Ok
Last Scan2024-09-29T11:11:22+00:00
Next Scan 2024-10-06T11:11:22+00:00

Last Scan

Scanned2024-09-29T11:11:22+00:00
URL https://biblio.sg/robots.txt
Domain IPs 104.26.10.198, 104.26.11.198, 172.67.73.27, 2606:4700:20::681a:ac6, 2606:4700:20::681a:bc6, 2606:4700:20::ac43:491b
Response IP 104.26.10.198
Found Yes
Hash e364c8cb6eadd9c554b76caca227e67b06435574b4b7268b78ac5e70a80a9a7e
SimHash 42985e613e59

Groups

*

Rule Path
Disallow /book/*/d/
Disallow /*/work/
Disallow /abrowse.php
Disallow /account_menu.php
Disallow /booksellers/
Disallow /app/booksellers/
Disallow /add_rental_to_cart.php
Disallow /app/jaxie/find_prices
Disallow /app/jaxie/meta_search
Disallow /app/offer/make
Disallow /b/
Disallow /banner.php
Disallow /bgsearch.php
Disallow /bookhounddownload/
Disallow /book_photos/
Disallow /browse_catalogs/
Disallow /cart.php
Disallow /create_account.php
Disallow /ebooks/
Disallow /email_listing.php
Disallow /favorite_booksellers.php
Disallow /info_request.php
Disallow /login.php
Disallow /login
Disallow /m/
Disallow /map.php
Disallow /o/
Disallow /omit/
Disallow /orderdetails.php
Disallow /print-on-demand/
Disallow /remote-search*
Disallow /rental_search.php
Disallow /review.php
Disallow /search.php
Disallow /secure-checkout/
Disallow /selling_books/account_registration.php
Disallow /shipping_estimate.php
Disallow /submit_recommendation.php
Disallow /utility/
Disallow /w/
Disallow /wants.php
Disallow /z/

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

boitho.com-dc

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

crawlbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

speedy

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /