catster.com
robots.txt
Robots Exclusion Standard data for catster.com
Resource Scan
Scan Details
| Site Domain | catster.com |
| Base Domain | catster.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T17:05:48+00:00 |
| Next Scan | 2024-11-20T17:05:48+00:00 |
Last Scan
| Scanned | 2024-11-13T17:05:48+00:00 |
| URL | https://catster.com/robots.txt |
| Domain IPs | 104.21.17.62, 172.67.222.252, 2606:4700:3035::6815:113e, 2606:4700:3036::ac43:defc |
| Response IP | 104.21.17.62 |
| Found | Yes |
| Hash | 28deece1e66b3262d2919a4e5d8e37f8c398ce007b35dbd7eb0889372bc58d30 |
| SimHash | 4100da02c333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /recommends/ |