nordicbet.dk
robots.txt
Robots Exclusion Standard data for nordicbet.dk
Resource Scan
Scan Details
Site Domain | nordicbet.dk |
Base Domain | nordicbet.dk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-02T02:37:38+00:00 |
Next Scan | 2024-12-02T02:37:38+00:00 |
Last Successful Scan
Scanned | 2024-09-10T22:54:01+00:00 |
URL | https://nordicbet.dk/robots.txt |
Redirect | https://www.nordicbet.dk:443/robots.txt |
Redirect Domain | www.nordicbet.dk |
Redirect Base | nordicbet.dk |
Domain IPs | 13.33.88.104, 13.33.88.126, 13.33.88.2, 13.33.88.89 |
Redirect IPs | 13.33.88.104, 13.33.88.126, 13.33.88.2, 13.33.88.89 |
Response IP | 13.33.88.89 |
Found | Yes |
Hash | f2968e835d3e26a3dbd04ba7f0365a5b52547ec3dc6470391f5c7ee5596f3f01 |
SimHash | 45245d308fd1 |
Groups
*
Rule | Path |
---|---|
Disallow | /*returnUrl%3D* |
Disallow | /*filter%3D* |
Disallow | /*action%3D* |
Disallow | /*ssr%3D0* |
Disallow | /betting/bet-builder/football/* |
Disallow | /betting/bet-builder/american-football/* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.nordicbet.dk/sitemap.xml |
Warnings
- `noindex` is not a known field.