radiostreamers.net
robots.txt
Robots Exclusion Standard data for radiostreamers.net
Resource Scan
Scan Details
| Site Domain | radiostreamers.net |
| Base Domain | radiostreamers.net |
| Scan Status | Ok |
| Last Scan | 2025-10-31T15:17:14+00:00 |
| Next Scan | 2025-11-07T15:17:14+00:00 |
Last Scan
| Scanned | 2025-10-31T15:17:14+00:00 |
| URL | https://radiostreamers.net/robots.txt |
| Domain IPs | 104.21.6.160, 172.67.135.3, 2606:4700:3032::ac43:8703, 2606:4700:3033::6815:6a0 |
| Response IP | 172.67.135.3 |
| Found | Yes |
| Hash | 89a18e713e9ae93559bc3e784f846b2f6dd0fac19c235c0daeadb0abe4bcd0c5 |
| SimHash | ec12d912ceb4 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /stations/ |
| Allow | /about/ |
| Allow | /submit-channel/ |
| Allow | /dmca/ |
| Allow | /contact/ |
| Allow | /privacy-policy/ |
| Allow | /terms-of-service/ |
| Disallow | /admin/ |
| Disallow | /login/ |
| Disallow | /register/ |
| Disallow | /user/ |
| Disallow | /rss/ |
| Disallow | /feed/ |
| Disallow | /sitemap.xml$ |
| Disallow | /track/ |
| Disallow | /assets/ |
| Disallow | /r/ |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 10 | Optional: Set a crawl delay of 10 seconds |