books.com
robots.txt
Robots Exclusion Standard data for books.com
Resource Scan
Scan Details
| Site Domain | books.com |
| Base Domain | books.com |
| Scan Status | Ok |
| Last Scan | 2024-11-01T17:01:03+00:00 |
| Next Scan | 2024-11-08T17:01:03+00:00 |
Last Scan
| Scanned | 2024-11-01T17:01:03+00:00 |
| URL | http://books.com/robots.txt |
| Redirect | https://www.barnesandnoble.com/robots.txt |
| Redirect Domain | www.barnesandnoble.com |
| Redirect Base | barnesandnoble.com |
| Domain IPs | 161.221.74.213, 65.204.48.118 |
| Redirect IPs | 23.210.99.86 |
| Response IP | 184.30.14.208 |
| Found | Yes |
| Hash | f5828e8c7885c9a29e329c05754d6781d37c8dfb6a30d00f81006d52db710f7a |
| SimHash | a14d1a416cd7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /mobile/account/ |
| Disallow | /checkout/ |
| Disallow | /mobile/checkout/ |
| Disallow | */lia.barnesandnoble/ |
| Disallow | /ajax? |
| Disallow | /www/search? |
| Disallow | /handler.jsp |
| Disallow | /google/ad |
| Disallow | /cartridges/ |
| Disallow | /includes/ |
| Disallow | /s/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.barnesandnoble.com/sitemap.xml |
Comments