mutstreams.su
robots.txt

Robots Exclusion Standard data for mutstreams.su

Resource Scan

Scan Details

Site Domain mutstreams.su
Base Domain mutstreams.su
Scan Status Ok
Last Scan2025-09-13T00:47:53+00:00
Next Scan 2025-10-13T00:47:53+00:00

Last Scan

Scanned2025-09-13T00:47:53+00:00
URL https://mutstreams.su/robots.txt
Domain IPs 104.21.1.162, 172.67.129.159, 2606:4700:3032::ac43:819f, 2606:4700:3035::6815:1a2
Response IP 104.21.1.162
Found Yes
Hash bb29275f9e64411789cf453beb53317c4858afa26be109d549462bef5115f9d9
SimHash 6608da10e5c3

Groups

*

Rule Path
Allow /
Allow /category/
Allow /watch/
Disallow /embed/
Disallow /multi-stream
Disallow /api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://mutstreams.su/sitemap.xml

Comments

  • Sitemap location
  • Crawl delay to be respectful