Log In Sign Up

cryptoguru.one
robots.txt

Robots Exclusion Standard data for cryptoguru.one

Resource Scan

Scan Details

Site Domain cryptoguru.one
Base Domain cryptoguru.one
Scan Status Ok
Last Scan2024-09-28T09:50:46+00:00
Next Scan 2024-10-05T09:50:46+00:00

Last Scan

Scanned2024-09-28T09:50:46+00:00
URL https://cryptoguru.one/robots.txt
Domain IPs 104.21.62.43, 172.67.219.246, 2606:4700:3031::ac43:dbf6, 2606:4700:3036::6815:3e2b
Response IP 104.21.62.43
Found Yes
Hash 5c9724176db4a941bcfcde31a47ae2a15c572bdd2c1b2fcc8a46601a0b38bcf4
SimHash 2cc911c65f19

Groups

*

Rule Path
Disallow /*terms-of-use$
Disallow /*policy-privacy$
Disallow /*privacy-policy$
Disallow /*ajax*
Disallow /auth/*
Disallow /*?*

googlebot

Rule Path
Disallow /*terms-of-use$
Disallow /*policy-privacy$
Disallow /*privacy-policy$
Disallow /*ajax*
Disallow /auth/*
Disallow /*?*

yandex

Rule Path
Disallow /*terms-of-use$
Disallow /*policy-privacy$
Disallow /*privacy-policy$
Disallow /*ajax*
Disallow /auth/*
Disallow /*?*
Back to top

Other Records

Field Value
sitemap https://cryptoguru.one/sitemap.xml
sitemap https://cryptoguru.one/ru/sitemap.xml
sitemap https://cryptoguru.one/es/sitemap.xml
sitemap https://cryptoguru.one/sw/sitemap.xml
sitemap https://cryptoguru.one/th/sitemap.xml
sitemap https://cryptoguru.one/ph/sitemap.xml
sitemap https://cryptoguru.one/de/sitemap.xml
sitemap https://cryptoguru.one/fr/sitemap.xml
sitemap https://cryptoguru.one/id/sitemap.xml
sitemap https://cryptoguru.one/it/sitemap.xml
sitemap https://cryptoguru.one/my/sitemap.xml
sitemap https://cryptoguru.one/pt/sitemap.xml
sitemap https://cryptoguru.one/vn/sitemap.xml
sitemap https://cryptoguru.one/ar/sitemap.xml
sitemap https://cryptoguru.one/tr/sitemap.xml
sitemap https://cryptoguru.one/ko/sitemap.xml
sitemap https://cryptoguru.one/ja/sitemap.xml
Back to top