minukataloogid.ee
robots.txt

Robots Exclusion Standard data for minukataloogid.ee

Resource Scan

Scan Details

Site Domain minukataloogid.ee
Base Domain minukataloogid.ee
Scan Status Ok
Last Scan2024-09-21T19:47:50+00:00
Next Scan 2024-09-28T19:47:50+00:00

Last Scan

Scanned2024-09-21T19:47:50+00:00
URL https://minukataloogid.ee/robots.txt
Domain IPs 104.21.43.164, 172.67.181.114, 2606:4700:3032::6815:2ba4, 2606:4700:3032::ac43:b572
Response IP 172.67.181.114
Found Yes
Hash 4614aeb78abc1b76219f63d30430888de0a44e35841b9ed5015b68b04c801e3d
SimHash 04455c36ab93

Groups

*

Rule Path
Disallow /admin
Disallow /n/*
Disallow *taghash*
Disallow *cutterhash*
Disallow *open-street-map*
Disallow /user*
Disallow *?*hash=*

semrushbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

Other Records

Field Value
sitemap https://minukataloogid.ee/sitemap-index.xml