mining-geologist.com
robots.txt

Robots Exclusion Standard data for mining-geologist.com

Resource Scan

Scan Details

Site Domain mining-geologist.com
Base Domain mining-geologist.com
Scan Status Ok
Last Scan2025-11-12T18:08:35+00:00
Next Scan 2025-11-19T18:08:35+00:00

Last Scan

Scanned2025-11-12T18:08:35+00:00
URL https://mining-geologist.com/robots.txt
Domain IPs 50.87.148.196
Response IP 50.87.148.196
Found Yes
Hash f45cd0eaa005438096bbe65370f783e27324b998b2080c251f27bef96bf467f1
SimHash 001e9d60ee9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://mining-geologist.com/?feed=xmlsitemap499
sitemap https://mining-geologist.com/?feed=xmlsitemap598