freecricket.net
robots.txt

Robots Exclusion Standard data for freecricket.net

Resource Scan

Scan Details

Site Domain freecricket.net
Base Domain freecricket.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-16T14:17:25+00:00
Next Scan 2024-11-15T14:17:25+00:00

Last Successful Scan

Scanned2024-07-19T14:16:19+00:00
URL https://freecricket.net/robots.txt
Domain IPs 104.21.43.15, 172.67.215.215, 2606:4700:3036::ac43:d7d7, 2606:4700:3037::6815:2b0f
Response IP 172.67.215.215
Found Yes
Hash 79c8c9cfd03f923b0940577fe699f5baacc93b71c96bcb006de87394c262e5b4
SimHash 0a1c9c60ae9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://freecricket.net/sitemap.xml