search.cpl.org
robots.txt
Robots Exclusion Standard data for search.cpl.org
Resource Scan
Scan Details
| Site Domain | search.cpl.org |
| Base Domain | cpl.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-11T00:29:16+00:00 |
| Next Scan | 2025-10-09T00:29:16+00:00 |
Last Successful Scan
| Scanned | 2025-02-18T23:45:32+00:00 |
| URL | https://search.cpl.org/robots.txt |
| Domain IPs | 34.162.139.192 |
| Response IP | 34.162.139.192 |
| Found | Yes |
| Hash | 15191ea63dd33b9dafdfc054f7b7ff999381e138ba3b4d9bf9b74ba3ab4bac4f |
| SimHash | 2c1a3cf048bb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?*view=excel* |
| Disallow | /*?*view=rss* |
| Disallow | /API/ |
| Disallow | /Admin/ |
| Disallow | /Author/AJAX |
| Disallow | /Axis360/*/AJAX* |
| Disallow | /Axis360/AJAX |
| Disallow | /CloudLibrary/*/AJAX* |
| Disallow | /CloudLibrary/AJAX |
| Disallow | /GroupedWork/*/AJAX |
| Disallow | /GroupedWork/AJAX |
| Disallow | /Hoopla/*/AJAX* |
| Disallow | /Hoopla/AJAX |
| Disallow | /MaterialsRequest/ |
| Disallow | /MyAccount/*/AJAX |
| Disallow | /MyAccount/AJAX |
| Disallow | /MyAccount/A |
| Disallow | /MyAccount/C |
| Disallow | /MyAccount/E |
| Disallow | /MyAccount/F |
| Disallow | /MyAccount/H |
| Disallow | /MyAccount/I |
| Disallow | /MyAccount/LibraryCard |
| Disallow | /MyAccount/LinkedAccounts |
| Disallow | /MyAccount/Masquerade |
| Disallow | /MyAccount/MessagingSettings |
| Disallow | /MyAccount/MyAccount |
| Disallow | /MyAccount/MyEvents |
| Disallow | /MyAccount/MyNotInterestedTitles |
| Disallow | /MyAccount/MyPreferences |
| Disallow | /MyAccount/MyRatings |
| Disallow | /MyAccount/O |
| Disallow | /MyAccount/P |
| Disallow | /MyAccount/R |
| Disallow | /MyAccount/SaveSearch |
| Disallow | /MyAccount/Security |
| Disallow | /MyAccount/SelectInterface |
| Disallow | /MyAccount/Staff |
| Disallow | /MyAccount/SuggestedTitles |
| Disallow | /MyAccount/W |
| Disallow | /OverDrive/*/AJAX* |
| Disallow | /OverDrive/AJAX |
| Disallow | /PalaceProject/*/AJAX* |
| Disallow | /PalaceProject/AJAX |
| Disallow | /Record/*/AJAX |
| Disallow | /Record/*/Search/ |
| Disallow | /Record/AJAX |
| Disallow | /Record/Search/ |
| Disallow | /Search/AJAX |
| Disallow | /SideLoads/*/AJAX* |
| Disallow | /SideLoads/AJAX |
| Disallow | /cgi-bin/ |
| Disallow | /images/fiveStar/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://search.cpl.org/sitemapindex.xml |
Warnings
- 2 invalid lines.