casino2020.co.uk
robots.txt

Robots Exclusion Standard data for casino2020.co.uk

Resource Scan

Scan Details

Site Domain casino2020.co.uk
Base Domain casino2020.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-02T21:29:20+00:00
Next Scan 2024-12-31T21:29:20+00:00

Last Successful Scan

Scanned2024-03-07T16:16:42+00:00
URL https://casino2020.co.uk/robots.txt
Redirect https://www.casino2020.co.uk/robots.txt
Redirect Domain www.casino2020.co.uk
Redirect Base casino2020.co.uk
Domain IPs 13.33.88.115, 13.33.88.49, 13.33.88.70, 13.33.88.71
Redirect IPs 13.33.88.115, 13.33.88.49, 13.33.88.70, 13.33.88.71
Response IP 13.33.88.49
Found Yes
Hash de2774b6fe88e4fbbf13ddc4e855b0a7cb821713d252efca80550e45f0a82f16
SimHash 78354c154ab3

Groups

*

Rule Path
Disallow /staging_v2/*
Disallow /itg-content/*
Disallow /itg-banners/*
Disallow /games/*
Disallow /casino/*
Disallow /casino-staging/*
Disallow /admin/*
Disallow /bingo/loyalty-shop/claim/*
Disallow /mk/*
Disallow /free-spins/*
Disallow /gamelanding
Disallow /gamelanding/*
Disallow /launcher/
Disallow /wp-admin/
Disallow /api_ajax/
Disallow /c/*
Disallow /cgi-bin/*
Disallow /utils/*
Disallow /wp-sitemap*

Other Records

Field Value
sitemap https://www.casino2020.co.uk/sitemp_index_itg.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
  • Disallow