biblio.pt
robots.txt
Robots Exclusion Standard data for biblio.pt
Resource Scan
Scan Details
| Site Domain | biblio.pt |
| Base Domain | biblio.pt |
| Scan Status | Ok |
| Last Scan | 2024-11-16T19:16:29+00:00 |
| Next Scan | 2024-11-23T19:16:29+00:00 |
Last Scan
| Scanned | 2024-11-16T19:16:29+00:00 |
| URL | https://biblio.pt/robots.txt |
| Domain IPs | 104.26.0.229, 104.26.1.229, 172.67.70.117, 2606:4700:20::681a:1e5, 2606:4700:20::681a:e5, 2606:4700:20::ac43:4675 |
| Response IP | 104.26.1.229 |
| Found | Yes |
| Hash | 7fd09455a4eee224e90950cd637fa104458dfb7818a76083eedd84ad1c36c6d2 |
| SimHash | 429c5e611e59 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /abrowse.php |
| Disallow | /account_menu.php |
| Disallow | /booksellers/ |
| Disallow | /app/booksellers/ |
| Disallow | /add_rental_to_cart.php |
| Disallow | /app/jaxie/find_prices |
| Disallow | /app/jaxie/meta_search |
| Disallow | /app/offer/make |
| Disallow | /b/ |
| Disallow | /banner.php |
| Disallow | /bgsearch.php |
| Disallow | /bookhounddownload/ |
| Disallow | /book_photos/ |
| Disallow | /browse_catalogs/ |
| Disallow | /cart.php |
| Disallow | /create_account.php |
| Disallow | /ebooks/ |
| Disallow | /email_listing.php |
| Disallow | /favorite_booksellers.php |
| Disallow | /info_request.php |
| Disallow | /login.php |
| Disallow | /login |
| Disallow | /m/ |
| Disallow | /map.php |
| Disallow | /o/ |
| Disallow | /omit/ |
| Disallow | /orderdetails.php |
| Disallow | /print-on-demand/ |
| Disallow | /remote-search* |
| Disallow | /rental_search.php |
| Disallow | /review.php |
| Disallow | /search.php |
| Disallow | /secure-checkout/ |
| Disallow | /selling_books/account_registration.php |
| Disallow | /shipping_estimate.php |
| Disallow | /submit_recommendation.php |
| Disallow | /utility/ |
| Disallow | /w/ |
| Disallow | /wants.php |
| Disallow | /z/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.biblio.com/blog/sitemap_index.xml |