muusikoiden.net
robots.txt
Robots Exclusion Standard data for muusikoiden.net
Resource Scan
Scan Details
Site Domain | muusikoiden.net |
Base Domain | muusikoiden.net |
Scan Status | Ok |
Last Scan | 2024-06-08T13:43:40+00:00 |
Next Scan | 2024-06-15T13:43:40+00:00 |
Last Scan
Scanned | 2024-06-08T13:43:40+00:00 |
URL | https://muusikoiden.net/robots.txt |
Domain IPs | 185.55.84.239 |
Response IP | 185.55.84.239 |
Found | Yes |
Hash | 37080cd57219360a6e65361384c177d79c658e12d1bad982c7939f552ae9d7e0 |
SimHash | 7b08dd54e600 |
Groups
simplepie/1.1.3 (feed parser; http://simplepie.org; allow like gecko) build/20081219
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cgi/ |
Disallow | /jasenet/oma/ |
Disallow | /jasenet/viestit/ |
Disallow | /keikat/service/ |
Disallow | /ihmeellinen/ |
Disallow | /nurmikolla/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://muusikoiden.net/sitemap.php |