coinhuntworldwiki.com
robots.txt

Robots Exclusion Standard data for coinhuntworldwiki.com

Resource Scan

Scan Details

Site Domain coinhuntworldwiki.com
Base Domain coinhuntworldwiki.com
Scan Status Ok
Last Scan2024-09-29T04:28:27+00:00
Next Scan 2024-10-06T04:28:27+00:00

Last Scan

Scanned2024-09-29T04:28:27+00:00
URL https://coinhuntworldwiki.com/robots.txt
Domain IPs 35.212.66.223
Response IP 35.212.66.223
Found Yes
Hash 92a47ccd3ca3b5d41432c3c501521154028f96c5f7f6fa1a066bb5309bb8092c
SimHash 3ada5d43c6f2

Groups

wget

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /
Disallow /Talk%3A
Disallow /Talk%3A
Disallow /User_talk%3A
Disallow /User_talk%3A
Disallow /File_talk%3A
Disallow /File_talk%3A
Disallow /MediaWiki%3A
Disallow /MediaWiki%3A
Disallow /MediaWiki_talk%3A
Disallow /MediaWiki_talk%3A
Disallow /Template%3A
Disallow /Template%3A
Disallow /Template_talk%3A
Disallow /Template_talk%3A
Disallow /Special%3A
Disallow /Special%3A

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://coinhuntworldwiki.com/sitemap.xml

Comments

  • robots.txt for https://coinhuntworldwiki.com
  • Talk
  • User talk
  • File talk
  • MediaWiki and MediaWiki talk
  • Template and Template talk
  • Special pages