sparkmusic.ru
robots.txt

Robots Exclusion Standard data for sparkmusic.ru

Resource Scan

Scan Details

Site Domain sparkmusic.ru
Base Domain sparkmusic.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/12/2025, 4:46:42 AM
Next Scan 7/11/2025, 4:46:42 AM

Last Successful Scan

Scanned10/28/2023, 12:29:34 AM
URL https://sparkmusic.ru/robots.txt
Domain IPs 104.21.58.194, 172.67.163.115, 2606:4700:3033::ac43:a373, 2606:4700:3034::6815:3ac2
Response IP 172.67.163.115
Found Yes
Hash a8375d68c8f4795144461260c7545c1ac7cb014796e6fc06188898d4d496ace9
SimHash 4550da704774

Groups

*

Rule Path
Allow /
Disallow /getmp3
Disallow /proxy
Disallow /index

Other Records

Field Value
crawl-delay 2.0

Warnings

  • `host` is not a known field.