biblio.ie
robots.txt
Robots Exclusion Standard data for biblio.ie
Resource Scan
Scan Details
Site Domain | biblio.ie |
Base Domain | biblio.ie |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-11T02:38:50+00:00 |
Next Scan | 2024-11-18T02:38:50+00:00 |
Last Successful Scan
Scanned | 2024-11-03T02:33:24+00:00 |
URL | https://biblio.ie/robots.txt |
Domain IPs | 104.26.14.120, 104.26.15.120, 172.67.68.227, 2606:4700:20::681a:e78, 2606:4700:20::681a:f78, 2606:4700:20::ac43:44e3 |
Response IP | 104.26.15.120 |
Found | Yes |
Hash | 2ef4a9469703b88d388d7ca06145eb30938cb9ae2e6278aa79ca599d5c2dfa1a |
SimHash | 42995e615e59 |
Groups
*
Rule | Path |
---|---|
Disallow | /abrowse.php |
Disallow | /account_menu.php |
Disallow | /booksellers/ |
Disallow | /app/booksellers/ |
Disallow | /add_rental_to_cart.php |
Disallow | /app/jaxie/find_prices |
Disallow | /app/jaxie/meta_search |
Disallow | /app/offer/make |
Disallow | /b/ |
Disallow | /banner.php |
Disallow | /bgsearch.php |
Disallow | /bookhounddownload/ |
Disallow | /book_photos/ |
Disallow | /browse_catalogs/ |
Disallow | /cart.php |
Disallow | /create_account.php |
Disallow | /ebooks/ |
Disallow | /email_listing.php |
Disallow | /favorite_booksellers.php |
Disallow | /info_request.php |
Disallow | /login.php |
Disallow | /login |
Disallow | /m/ |
Disallow | /map.php |
Disallow | /o/ |
Disallow | /orderdetails.php |
Disallow | /print-on-demand/ |
Disallow | /remote-search* |
Disallow | /rental_search.php |
Disallow | /review.php |
Disallow | /search.php |
Disallow | /secure-checkout/ |
Disallow | /selling_books/account_registration.php |
Disallow | /shipping_estimate.php |
Disallow | /submit_recommendation.php |
Disallow | /utility/ |
Disallow | /w/ |
Disallow | /wants.php |
Disallow | /z/ |