minukataloogid.ee
robots.txt
Robots Exclusion Standard data for minukataloogid.ee
Resource Scan
Scan Details
Site Domain | minukataloogid.ee |
Base Domain | minukataloogid.ee |
Scan Status | Ok |
Last Scan | 2024-09-21T19:47:50+00:00 |
Next Scan | 2024-09-28T19:47:50+00:00 |
Last Scan
Scanned | 2024-09-21T19:47:50+00:00 |
URL | https://minukataloogid.ee/robots.txt |
Domain IPs | 104.21.43.164, 172.67.181.114, 2606:4700:3032::6815:2ba4, 2606:4700:3032::ac43:b572 |
Response IP | 172.67.181.114 |
Found | Yes |
Hash | 4614aeb78abc1b76219f63d30430888de0a44e35841b9ed5015b68b04c801e3d |
SimHash | 04455c36ab93 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /n/* |
Disallow | *taghash* |
Disallow | *cutterhash* |
Disallow | *open-street-map* |
Disallow | /user* |
Disallow | *?*hash=* |
Other Records
Field | Value |
---|---|
sitemap | https://minukataloogid.ee/sitemap-index.xml |