internetogreitis.lt
robots.txt
Robots Exclusion Standard data for internetogreitis.lt
Resource Scan
Scan Details
| Site Domain | internetogreitis.lt |
| Base Domain | internetogreitis.lt |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-25T06:51:26+00:00 |
| Next Scan | 2024-09-24T06:51:26+00:00 |
Last Successful Scan
| Scanned | 2024-07-27T06:50:45+00:00 |
| URL | https://internetogreitis.lt/robots.txt |
| Domain IPs | 2a02:4780:16:54cb:86d0:d689:ec0c:e9c4, 84.32.84.111 |
| Response IP | 77.37.48.252 |
| Found | Yes |
| Hash | e675c140bf7bfb75bff70a05b62e2d97adb91809cc7fe73e80b9c00846ea9f2c |
| SimHash | e200cc02e2b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?reviews-page=* |
| Disallow | /*?*reviews-page=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |