mines.bet
robots.txt

Robots Exclusion Standard data for mines.bet

Resource Scan

Scan Details

Site Domain mines.bet
Base Domain mines.bet
Scan Status Ok
Last Scan2025-10-30T23:34:50+00:00
Next Scan 2025-11-29T23:34:50+00:00

Last Scan

Scanned2025-10-30T23:34:50+00:00
URL https://mines.bet/robots.txt
Domain IPs 104.21.45.21, 172.67.207.208, 2606:4700:3032::6815:2d15, 2606:4700:3037::ac43:cfd0
Response IP 172.67.207.208
Found Yes
Hash 4ad4e5905f59092e128ddffe08313718feb25dd4c3b294af2d6eb2f707999ad0
SimHash 420cdb51eeb3

Groups

*

Rule Path
Allow /
Disallow /api/*
Disallow /go/*
Disallow /pages/condition-utilisation

ahrefsbot

Rule Path
Disallow *

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow *

screaming frog seo spider

Rule Path
Disallow *

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mines.bet/sitemap.xml