coingape.com
robots.txt

Robots Exclusion Standard data for coingape.com

Resource Scan

Scan Details

Site Domain coingape.com
Base Domain coingape.com
Scan Status Ok
Last Scan2024-07-02T18:59:39+00:00
Next Scan 2024-07-09T18:59:39+00:00

Last Scan

Scanned2024-07-02T18:59:39+00:00
URL https://coingape.com/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash 67a3903b9ccd68fd919b6fa8f5b4c1ab5127f8e011351bc2b833f869dd6e0763
SimHash d02adf70a0e3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /aggregatorapps*
Disallow /api*
Disallow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow */?s
Disallow */search_gcse/
Disallow */page

cryptovan.news - bot

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semetrical

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

trovitbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

wesee_bot

Rule Path
Disallow /
Disallow *?amount*

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://coingape.com/sitemap_index.xml
sitemap https://coingape.com/news-sitemap.xml

Comments

  • WP Import Export Rule