best-streamers.com
robots.txt
Robots Exclusion Standard data for best-streamers.com
Resource Scan
Scan Details
Site Domain | best-streamers.com |
Base Domain | best-streamers.com |
Scan Status | Ok |
Last Scan | 2024-11-11T04:23:54+00:00 |
Next Scan | 2024-11-18T04:23:54+00:00 |
Last Scan
Scanned | 2024-11-11T04:23:54+00:00 |
URL | https://best-streamers.com/robots.txt |
Domain IPs | 104.21.81.42, 172.67.138.26, 2606:4700:3030::6815:512a, 2606:4700:3037::ac43:8a1a |
Response IP | 172.67.138.26 |
Found | Yes |
Hash | 80f2c5d00f4250bb6d35d910acce0bbc516c2fbe68ccc92cdd0cf48dcdeca91d |
SimHash | b8302480c7d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /video-related.php |
Disallow | /fpembed.php |
Disallow | /search.php |
Disallow | /embed.php |
Disallow | /embed/ |
Disallow | /mobile/ |