biblio.com.au
robots.txt
Robots Exclusion Standard data for biblio.com.au
Resource Scan
Scan Details
Site Domain | biblio.com.au |
Base Domain | biblio.com.au |
Scan Status | Ok |
Last Scan | 2024-11-16T10:49:16+00:00 |
Next Scan | 2024-11-23T10:49:16+00:00 |
Last Scan
Scanned | 2024-11-16T10:49:16+00:00 |
URL | https://biblio.com.au/robots.txt |
Domain IPs | 104.26.2.167, 104.26.3.167, 172.67.75.150, 2606:4700:20::681a:2a7, 2606:4700:20::681a:3a7, 2606:4700:20::ac43:4b96 |
Response IP | 172.67.75.150 |
Found | Yes |
Hash | 2ef4a9469703b88d388d7ca06145eb30938cb9ae2e6278aa79ca599d5c2dfa1a |
SimHash | 42995e615e59 |
Groups
*
Rule | Path |
---|---|
Disallow | /abrowse.php |
Disallow | /account_menu.php |
Disallow | /booksellers/ |
Disallow | /app/booksellers/ |
Disallow | /add_rental_to_cart.php |
Disallow | /app/jaxie/find_prices |
Disallow | /app/jaxie/meta_search |
Disallow | /app/offer/make |
Disallow | /b/ |
Disallow | /banner.php |
Disallow | /bgsearch.php |
Disallow | /bookhounddownload/ |
Disallow | /book_photos/ |
Disallow | /browse_catalogs/ |
Disallow | /cart.php |
Disallow | /create_account.php |
Disallow | /ebooks/ |
Disallow | /email_listing.php |
Disallow | /favorite_booksellers.php |
Disallow | /info_request.php |
Disallow | /login.php |
Disallow | /login |
Disallow | /m/ |
Disallow | /map.php |
Disallow | /o/ |
Disallow | /orderdetails.php |
Disallow | /print-on-demand/ |
Disallow | /remote-search* |
Disallow | /rental_search.php |
Disallow | /review.php |
Disallow | /search.php |
Disallow | /secure-checkout/ |
Disallow | /selling_books/account_registration.php |
Disallow | /shipping_estimate.php |
Disallow | /submit_recommendation.php |
Disallow | /utility/ |
Disallow | /w/ |
Disallow | /wants.php |
Disallow | /z/ |