spreaker.com
robots.txt
Robots Exclusion Standard data for spreaker.com
Resource Scan
Scan Details
Site Domain | spreaker.com |
Base Domain | spreaker.com |
Scan Status | Ok |
Last Scan | 2024-09-27T12:30:57+00:00 |
Next Scan | 2024-10-04T12:30:57+00:00 |
Last Scan
Scanned | 2024-09-27T12:30:57+00:00 |
URL | https://spreaker.com/robots.txt |
Redirect | https://www.spreaker.com/robots.txt |
Redirect Domain | www.spreaker.com |
Redirect Base | spreaker.com |
Domain IPs | 54.230.112.27, 54.230.112.3, 54.230.112.82, 54.230.112.89 |
Redirect IPs | 18.66.147.121, 18.66.147.31, 18.66.147.40, 18.66.147.83 |
Response IP | 18.165.140.8 |
Found | Yes |
Hash | ffd5034e9934dcf7815574e03d0f4d9cd9993025366d39251167e6711ca6936d |
SimHash | e825b9496d52 |
Groups
*
Rule | Path |
---|---|
Disallow | /lang/ |
Disallow | /share/ |
Disallow | /test/ |
Disallow | /dev/ |
Disallow | /page |
Disallow | /user/*/episodes/feed |
Disallow | /s/ |
Disallow | /e/ |