Log In Sign Up

blackthornsdesign.com
robots.txt

Robots Exclusion Standard data for blackthornsdesign.com

Resource Scan

Scan Details

Site Domain blackthornsdesign.com
Base Domain blackthornsdesign.com
Scan Status Ok
Last Scan2025-05-09T21:47:54+00:00
Next Scan 2025-06-08T21:47:54+00:00

Last Scan

Scanned2025-05-09T21:47:54+00:00
URL https://blackthornsdesign.com/robots.txt
Domain IPs 2001:8d8:100f:f000::262, 217.160.0.163
Response IP 217.160.0.163
Found Yes
Hash 14a6c9e0e190183078fdf84995da8fed1fe62006b21ae3b7e5a5b0cbefccd3db
SimHash 29455f960273

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-config.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /clients
Disallow /mailing
Disallow /responsivewebapps
Disallow /global/apps
Disallow /global/languages
Disallow /global/themes
Disallow /global/upgrade
Disallow /category/*/*
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?
Allow /en/

googlebot

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.pdf$

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap https://blackthornsdesign.com/sitemap_index.xml
sitemap https://blackthornsdesign.com/post-sitemap.xml
sitemap https://blackthornsdesign.com/page-sitemap.xml
Back to top

Comments

  • Protection of sensitive directories
  • Explicitly allow English pages
  • Protection of sensitive files
  • Allow Google Image
  • Allow Google AdSense
  • Sitemap declarations
Back to top