okusno.je
robots.txt
Robots Exclusion Standard data for okusno.je
Resource Scan
Scan Details
Site Domain | okusno.je |
Base Domain | okusno.je |
Scan Status | Ok |
Last Scan | 2024-11-13T10:02:16+00:00 |
Next Scan | 2024-11-20T10:02:16+00:00 |
Last Scan
Scanned | 2024-11-13T10:02:16+00:00 |
URL | https://okusno.je/robots.txt |
Domain IPs | 199.232.194.133, 199.232.198.133 |
Response IP | 199.232.194.133 |
Found | Yes |
Hash | d38b6d2399988776b344a883ecbd4b7fe86ebeac8fd4363d863db5cf506893e6 |
SimHash | 6c60dc608e93 |
Groups
*
Rule | Path |
---|---|
Disallow | /iskanje |
Disallow | /bin/ |
Disallow | /lbin/ |
Disallow | /adserver/ |
Disallow | /users/ |
Disallow | *modal%3A* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://okusno.je/sitemaps/sites/30009 |