betsafe101.com
robots.txt
Robots Exclusion Standard data for betsafe101.com
Resource Scan
Scan Details
Site Domain | betsafe101.com |
Base Domain | betsafe101.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-07T10:04:56+00:00 |
Next Scan | 2024-11-21T10:04:56+00:00 |
Last Successful Scan
Scanned | 2024-09-25T10:01:18+00:00 |
URL | https://betsafe101.com/robots.txt |
Domain IPs | 3.165.102.118, 3.165.102.30, 3.165.102.34, 3.165.102.46 |
Response IP | 3.165.102.46 |
Found | Yes |
Hash | 89bf652ca0532d0c340e4a3d5285e2f99e3867976dee8096fa2f2751d12dd48c |
SimHash | 7806cc1e8713 |
Groups
*
Rule | Path |
---|---|
Disallow | /en/ |
Disallow | /eu/ |
Disallow | /sv/ |
Disallow | /fi/ |
Disallow | /es/ |
Disallow | /pe/ |
Disallow | /ca/ |
Disallow | /*returnUrl%3D* |
Disallow | /*filter%3D* |
Disallow | /*action%3D* |
Disallow | /*ssr%3D0* |
Disallow | /pl/zaklady-sportowe/zbuduj-zaklad/football/* |
Disallow | /pl/zaklady-sportowe/zbuduj-zaklad/american-football/* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://betsafe101.com/sitemap.xml |
Warnings
- `noindex` is not a known field.