chirpbooks.com
robots.txt
Robots Exclusion Standard data for chirpbooks.com
Resource Scan
Scan Details
| Site Domain | chirpbooks.com |
| Base Domain | chirpbooks.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-10T16:43:56+00:00 |
| Next Scan | 2024-11-24T16:43:56+00:00 |
Last Successful Scan
| Scanned | 2023-11-04T01:01:23+00:00 |
| URL | https://chirpbooks.com/robots.txt |
| Redirect | https://www.chirpbooks.com/robots.txt |
| Redirect Domain | www.chirpbooks.com |
| Redirect Base | chirpbooks.com |
| Domain IPs | 54.192.150.24, 54.192.150.43, 54.192.150.58, 54.192.150.99 |
| Redirect IPs | 104.18.6.56, 104.18.7.56, 2606:4700::6812:638, 2606:4700::6812:738 |
| Response IP | 104.18.6.56 |
| Found | Yes |
| Hash | 3ee2f5c5a684e228c1a3735b2e8f5af869513f8c47b00a7401d34319ed599b3e |
| SimHash | 630dd880a1b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /survey* |
| Disallow | /warble* |
| Disallow | /checkout* |
| Disallow | /users/subscribe* |
| Disallow | /*?*tkn=* |
| Disallow | /player* |
| Disallow | /purchases/new* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.chirpbooks.com/sitemap.xml.gz |