Log In Sign Up

indonesiacocopeat.com
robots.txt

Robots Exclusion Standard data for indonesiacocopeat.com

Resource Scan

Scan Details

Site Domain indonesiacocopeat.com
Base Domain indonesiacocopeat.com
Scan Status Ok
Last Scan6/12/2025, 10:54:53 AM
Next Scan 7/12/2025, 10:54:53 AM

Last Scan

Scanned6/12/2025, 10:54:53 AM
URL https://indonesiacocopeat.com/robots.txt
Domain IPs 104.21.88.13, 172.67.171.238, 2606:4700:3034::ac43:abee, 2606:4700:3037::6815:580d
Response IP 104.21.88.13
Found Yes
Hash 4f8cfe6a2f5ec8f5f57e1720d0e96b206733a544b0eed93d425636857f3fc890
SimHash 611b1787b6e3

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /wp-content/*
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-login.php
Disallow /trackback
Disallow /author
Disallow /page
Disallow /page/*
Disallow /page/
Disallow /category//
Disallow */trackback
Disallow /?
Disallow /*?
Disallow /rss_class/
Disallow /img/
Disallow /images/
Disallow /ads/
Disallow /inc/
Disallow /tag/
Disallow /tag//
Disallow /search/
Disallow /search//
Disallow /category//
Disallow /category/
Disallow /?s=
Disallow /?s=*

googlebot

Rule Path
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.cgi$
Disallow /*.wmv$
Disallow /*.gif$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.php*
Disallow */trackback*

googlebot-mobile

Rule Path
Allow /*

twitterbot

Rule Path
Allow /*.png$
Allow /*.jpg$

facebookexternalhit

Rule Path
Allow /*.png$
Allow /*.jpg$

mediapartners-google*

Rule Path
Disallow
Allow /*

duggmirror

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /
Back to top

Comments

  • robots.txt file for https://indonesiacocopeat.com/
  • disallow all files ending with these extensions
  • allow google image bot to search all images
  • allow adsense bot on entire site
  • disable duggmirror
  • disallow Internet Archiver Wayback Machine
Back to top

Warnings

  • 1 invalid line.
Back to top