crypto.games
robots.txt

Robots Exclusion Standard data for crypto.games

Resource Scan

Scan Details

Site Domain crypto.games
Base Domain crypto.games
Scan Status Ok
Last Scan2025-03-16T22:45:05+00:00
Next Scan 2025-04-15T22:45:05+00:00

Last Scan

Scanned2025-03-16T22:45:05+00:00
URL https://crypto.games/robots.txt
Domain IPs 172.66.40.191, 172.66.43.65, 2606:4700:3108::ac42:28bf, 2606:4700:3108::ac42:2b41
Response IP 172.66.40.191
Found Yes
Hash c27eba9bee8dbab6a188f290e8580ec9b0135fe5c6545db2a8737f50a1ddf0d9
SimHash 68dcdcd68492

Groups

*

Rule Path
Disallow /account/*
Disallow /chat/*
Disallow /logout
Disallow /login
Disallow /bet/*
Disallow /terms
Disallow /aboutus
Disallow /aml
Disallow /privacy
Disallow /codeofconduct
Disallow /contests
Disallow /*.asmx$

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap /sitemap.xml