grepler.com
robots.txt
Robots Exclusion Standard data for grepler.com
Resource Scan
Scan Details
| Site Domain | grepler.com |
| Base Domain | grepler.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-09-29T05:18:31+00:00 |
| Next Scan | 2024-12-28T05:18:31+00:00 |
Last Successful Scan
| Scanned | 2022-12-07T17:57:38+00:00 |
| URL | https://grepler.com/robots.txt |
| Domain IPs | 104.21.3.18, 172.67.130.10, 2606:4700:3033::ac43:820a, 2606:4700:3037::6815:312 |
| Response IP | 172.67.130.10 |
| Found | Yes |
| Hash | f025161b078a805df50b5d3e717c4787c53e61350989e9eedf85d85be385a395 |
| SimHash | 10146c2283e3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /contacts |
| Disallow | /posts |
| Allow | / |