crappie.com
robots.txt
Robots Exclusion Standard data for crappie.com
Resource Scan
Scan Details
| Site Domain | crappie.com |
| Base Domain | crappie.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-10T19:52:31+00:00 |
| Next Scan | 2024-12-09T19:52:31+00:00 |
Last Successful Scan
| Scanned | 2024-02-14T18:56:34+00:00 |
| URL | https://crappie.com/robots.txt |
| Domain IPs | 104.26.8.19, 104.26.9.19, 172.67.69.218, 2606:4700:20::681a:813, 2606:4700:20::681a:913, 2606:4700:20::ac43:45da |
| Response IP | 104.26.9.19 |
| Found | Yes |
| Hash | f9df0c810fc6a4ef7ded8ce5360c7dd3e2198ab899a8feceef2d55ef63c67bea |
| SimHash | ab2cc57863d8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /components/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |