btcmanager.com
robots.txt

Robots Exclusion Standard data for btcmanager.com

Resource Scan

Scan Details

Site Domain btcmanager.com
Base Domain btcmanager.com
Scan Status Ok
Last Scan2024-11-12T06:45:06+00:00
Next Scan 2024-11-19T06:45:06+00:00

Last Scan

Scanned2024-11-12T06:45:06+00:00
URL https://btcmanager.com/robots.txt
Redirect https://crypto.news/robots.txt
Redirect Domain crypto.news
Redirect Base crypto.news
Domain IPs 164.90.245.117
Redirect IPs 104.26.10.146, 104.26.11.146, 172.67.69.25, 2606:4700:20::681a:a92, 2606:4700:20::681a:b92, 2606:4700:20::ac43:4519
Response IP 104.26.10.146
Found Yes
Hash 9700a3fcb9ad9d2de0b4c6da9f77695f0eac1078652b43835de896afefefdc32
SimHash 2530d401a4b3

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /?s=
Disallow /?amp=
Disallow /?q=
Disallow /search/
Disallow /cdn-cgi/
Disallow /download/
Disallow /wp/wp-login.php
Disallow /wp/wp-register.php
Disallow /trackback/
Allow /*.js
Allow /*.css
Disallow /*?p=*
Disallow /*?utm_*
Disallow /*?nonamp=*

Other Records

Field Value
sitemap https://crypto.news/sitemap_index.xml
sitemap https://crypto.news/news-sitemap.xml
sitemap https://crypto.news/cn_cryptocurrency-sitemap.xml