betsafe94.com
robots.txt

Robots Exclusion Standard data for betsafe94.com

Resource Scan

Scan Details

Site Domain betsafe94.com
Base Domain betsafe94.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-03T20:13:48+00:00
Next Scan 2024-11-17T20:13:48+00:00

Last Successful Scan

Scanned2024-09-28T09:30:01+00:00
URL https://betsafe94.com/robots.txt
Redirect https://www.betsafe101.com/robots.txt
Redirect Domain www.betsafe101.com
Redirect Base betsafe101.com
Domain IPs 18.157.49.167, 3.126.109.202, 52.58.104.133
Redirect IPs 3.165.102.118, 3.165.102.30, 3.165.102.34, 3.165.102.46
Response IP 3.165.102.46
Found Yes
Hash b22622b4497d848f1311be51cb62bd2e4073b5c6701e316f457bcfc8862700c9
SimHash 7906ec1c8713

Groups

*

Rule Path
Disallow /en/
Disallow /eu/
Disallow /sv/
Disallow /fi/
Disallow /es/
Disallow /pe/
Disallow /ca/
Disallow /*returnUrl%3D*
Disallow /*filter%3D*
Disallow /*action%3D*
Disallow /*ssr%3D0*
Disallow /pl/zaklady-sportowe/zbuduj-zaklad/football/*
Disallow /pl/zaklady-sportowe/zbuduj-zaklad/american-football/*

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.betsafe101.com/sitemap.xml

Warnings

  • `noindex` is not a known field.