coingape.com
robots.txt

Robots Exclusion Standard data for coingape.com

Resource Scan

Scan Details

Site Domain coingape.com
Base Domain coingape.com
Scan Status Ok
Last Scan2024-11-13T17:03:55+00:00
Next Scan 2024-11-20T17:03:55+00:00

Last Scan

Scanned2024-11-13T17:03:55+00:00
URL https://coingape.com/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash 555a3e5e7733455767f6df7813b9f4f8f626f7e9fc21b558969367beb005c81e
SimHash d02adf70a0e3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /aggregatorapps*
Disallow /api*
Disallow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow */?s
Disallow */search_gcse/
Disallow */page

cryptovan.news - bot

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semetrical

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

trovitbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

wesee_bot

Rule Path
Disallow /
Disallow *?amount*

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://coingape.com/sitemap_index.xml
sitemap https://coingape.com/news-sitemap.xml

Comments

  • WP Import Export Rule