cyberbajt.pl
robots.txt
Robots Exclusion Standard data for cyberbajt.pl
Resource Scan
Scan Details
| Site Domain | cyberbajt.pl |
| Base Domain | cyberbajt.pl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-05-23T20:44:24+00:00 |
| Next Scan | 2025-08-21T20:44:24+00:00 |
Last Successful Scan
| Scanned | 2025-01-01T20:42:18+00:00 |
| URL | https://www.cyberbajt.pl/robots.txt |
| Domain IPs | 104.21.87.67, 172.67.142.44, 2606:4700:3030::ac43:8e2c, 2606:4700:3035::6815:5743 |
| Response IP | 104.21.87.67 |
| Found | Yes |
| Hash | 00737afdc27f08646b79b0474d087f0ddc6ff7dfd65b1d92726e478c6ed58701 |
| SimHash | ed750c76a892 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tmp/ |
| Disallow | /temp/ |
| Disallow | /cache/ |
| Disallow | /admin/ |
| Disallow | /administration/ |
| Disallow | /root/ |
| Disallow | /private/ |
| Disallow | /install/ |
| Disallow | /page/202/8/innowacyjna-gospodarka.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cyberbajt.pl/dat/sitemap.xml |