pik.ba
robots.txt
Robots Exclusion Standard data for pik.ba
Resource Scan
Scan Details
Site Domain | pik.ba |
Base Domain | pik.ba |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-21T09:03:02+00:00 |
Next Scan | 2024-10-05T09:03:02+00:00 |
Last Successful Scan
Scanned | 2023-05-26T06:59:34+00:00 |
URL | https://pik.ba/robots.txt |
Domain IPs | 104.27.203.89, 104.27.204.89, 2606:4700:21::681b:cb59, 2606:4700:21::681b:cc59 |
Response IP | 104.27.204.89 |
Found | Yes |
Hash | 4df383cc31a285cd4a40fef0d33be7268c6ed448bdf536405c1f2ab23722a241 |
SimHash | 2d04d8844153 |
Groups
*
Rule | Path |
---|---|
Disallow | /rss3.php |
Disallow | /poruke |
Disallow | /mojpik |
Disallow | /postavke |
Disallow | /ajax |
Disallow | /artikal/detaljni_opis |
Disallow | /*/uredi |
Other Records
Field | Value |
---|---|
sitemap | http://www.olx.ba/sitemap.xml |