betsafe94.com
robots.txt
Robots Exclusion Standard data for betsafe94.com
Resource Scan
Scan Details
Site Domain | betsafe94.com |
Base Domain | betsafe94.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-03T20:13:48+00:00 |
Next Scan | 2024-11-17T20:13:48+00:00 |
Last Successful Scan
Scanned | 2024-09-28T09:30:01+00:00 |
URL | https://betsafe94.com/robots.txt |
Redirect | https://www.betsafe101.com/robots.txt |
Redirect Domain | www.betsafe101.com |
Redirect Base | betsafe101.com |
Domain IPs | 18.157.49.167, 3.126.109.202, 52.58.104.133 |
Redirect IPs | 3.165.102.118, 3.165.102.30, 3.165.102.34, 3.165.102.46 |
Response IP | 3.165.102.46 |
Found | Yes |
Hash | b22622b4497d848f1311be51cb62bd2e4073b5c6701e316f457bcfc8862700c9 |
SimHash | 7906ec1c8713 |
Groups
*
Rule | Path |
---|---|
Disallow | /en/ |
Disallow | /eu/ |
Disallow | /sv/ |
Disallow | /fi/ |
Disallow | /es/ |
Disallow | /pe/ |
Disallow | /ca/ |
Disallow | /*returnUrl%3D* |
Disallow | /*filter%3D* |
Disallow | /*action%3D* |
Disallow | /*ssr%3D0* |
Disallow | /pl/zaklady-sportowe/zbuduj-zaklad/football/* |
Disallow | /pl/zaklady-sportowe/zbuduj-zaklad/american-football/* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.betsafe101.com/sitemap.xml |
Warnings
- `noindex` is not a known field.