iberlibro.com
robots.txt

Robots Exclusion Standard data for iberlibro.com

Resource Scan

Scan Details

Site Domain iberlibro.com
Base Domain iberlibro.com
Scan Status Ok
Last Scan2024-05-07T16:15:30+00:00
Next Scan 2024-06-06T16:15:30+00:00

Last Scan

Scanned2024-05-07T16:15:30+00:00
URL https://iberlibro.com/robots.txt
Redirect https://www.iberlibro.com/robots.txt
Redirect Domain www.iberlibro.com
Redirect Base iberlibro.com
Domain IPs 13.33.88.12, 13.33.88.128, 13.33.88.38, 13.33.88.85
Redirect IPs 13.33.88.12, 13.33.88.128, 13.33.88.38, 13.33.88.85
Response IP 13.33.88.38
Found Yes
Hash 7d84c99267c63ff4b377cfa3f40c2441357d776926069eb6bce0eaf00ef4e1cd
SimHash a0c5f9414616

Groups

*

Rule Path
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/
Disallow /search/
Disallow /*/%24galleryLink
Disallow /colecciones/

googlebot

Rule Path
Allow /search/
Allow /servlet/SearchResults
Allow /servlet/BookstoreSearch
Allow /servlet/BookDetailsPL
Allow /servlet/BrowseListingsResults
Allow /servlet/BrowseListingsEntry
Allow /servlet/ListingDetails
Allow /servlet/StoreFrontDisplay
Allow /abe/ListingDetails
Allow /servlet/DWRestService/
Allow /servlet/RecommendationsApi
Allow /servlet/HighlightInventory
Allow /colecciones/
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/
Disallow /*IMAGE_URL$

adsbot-google

Rule Path
Disallow /servlet/HighlightInventory

msnbot

Rule Path
Allow /search/
Allow /servlet/SearchResults
Allow /servlet/BookDetailsPL
Allow /servlet/BookstoreSearch
Allow /servlet/BrowseListingsResults
Allow /servlet/BrowseListingsEntry
Allow /servlet/ListingDetails
Allow /servlet/StoreFrontDisplay
Allow /abe/ListingDetails
Allow /servlet/DWRestService/
Allow /colecciones/
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/

bingbot

Rule Path
Allow /search/
Allow /servlet/SearchResults
Allow /servlet/BookDetailsPL
Allow /servlet/BookstoreSearch
Allow /servlet/BrowseListingsResults
Allow /servlet/BrowseListingsEntry
Allow /servlet/ListingDetails
Allow /servlet/StoreFrontDisplay
Allow /abe/ListingDetails
Allow /servlet/DWRestService/
Allow /colecciones/
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/

slurp

Rule Path
Allow /search/
Allow /servlet/SearchResults
Allow /servlet/BookDetailsPL
Allow /servlet/BookstoreSearch
Allow /servlet/BrowseListingsResults
Allow /servlet/BrowseListingsEntry
Allow /servlet/ListingDetails
Allow /servlet/StoreFrontDisplay
Allow /abe/ListingDetails
Allow /servlet/DWRestService/
Allow /colecciones/
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/

rogerbot

Rule Path
Disallow /author/
Disallow /blog/
Disallow /search/
Disallow /buscar-libro/
Disallow /abe/ListingDetails
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/
Disallow /docs/Newsletters/BD
Disallow /site-map/
Disallow /textbook/isbn
Disallow /products/isbn/
Disallow /top-authors/
Disallow /titles/
Disallow /docs/Newsletters/
Disallow /*plp$
Disallow /*sf$
Disallow /*bd$

claritybot

Rule Path
Disallow /author/
Disallow /search/
Disallow /buscar-libro/
Disallow /abe/ListingDetails
Disallow /servlet/
Disallow /abe/
Disallow /abep/
Disallow /cgi/
Disallow /docs/Newsletters/BD
Disallow /site-map/
Disallow /textbook/isbn
Disallow /textbook/top-selling-textbooks/
Disallow /products/isbn/
Disallow /top-authors/
Disallow /titles/
Disallow /docs/Newsletters/
Disallow /*plp$
Disallow /*sf$
Disallow /*bd$

mediapartners-google

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.iberlibro.com/sitemap.bdp_index.xml
sitemap https://www.iberlibro.com/sitemap.plp_index.xml
sitemap https://www.iberlibro.com/brightspot-sitemap.xml

Comments

  • Sitemap files