unibet.com
robots.txt
Robots Exclusion Standard data for unibet.com
Resource Scan
Scan Details
| Site Domain | unibet.com |
| Base Domain | unibet.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-09-10T15:57:25+00:00 |
| Next Scan | 2024-12-09T15:57:25+00:00 |
Last Successful Scan
| Scanned | 2024-05-07T11:16:59+00:00 |
| URL | https://unibet.com/robots.txt |
| Redirect | https://www.unibet.com/?ot=com.atex.plugins.seoplugin.RobotsTxt.ot |
| Redirect Domain | www.unibet.com |
| Redirect Base | unibet.com |
| Domain IPs | 85.184.96.28 |
| Redirect IPs | 85.184.96.28 |
| Response IP | 85.184.96.28 |
| Found | Yes |
| Hash | 7b31aac0f5fb8dbbdc3b8492e34df25aadb9e236d64578c41eaadb832ff4a064 |
| SimHash | 415450468605 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /casino-rest-api* |
| Disallow | /softgames-rest-api* |
| Disallow | /bingo-rest-api* |
| Disallow | /custard* |
| Disallow | /*.do$ |
| Disallow | /*.odds$ |
| Disallow | /*.json$ |
| Disallow | /*.jsp$ |
| Disallow | /cms/ |
| Disallow | /js/footer/ |
| Disallow | /nj* |
| Disallow | /nj/maintenance* |
| Disallow | /2.* |