countrythangdaily.com
robots.txt

Robots Exclusion Standard data for countrythangdaily.com

Resource Scan

Scan Details

Site Domain countrythangdaily.com
Base Domain countrythangdaily.com
Scan Status Ok
Last Scan2024-09-24T19:28:44+00:00
Next Scan 2024-10-01T19:28:44+00:00

Last Scan

Scanned2024-09-24T19:28:44+00:00
URL https://countrythangdaily.com/robots.txt
Domain IPs 104.21.80.233, 172.67.155.133, 2606:4700:3034::6815:50e9, 2606:4700:3036::ac43:9b85
Response IP 104.21.80.233
Found Yes
Hash 0562779c924b7601c66726ca1ce07d0c293a935f03e88d0934afb041fd8cda73
SimHash 7fc759673c76

Groups

googlebot

Rule Path
Allow .js
Allow .css
Allow /wp-admin/admin-ajax.php
Disallow *feed/
Disallow /tag
Disallow *?amp%2F

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /*.com/
Disallow /*/.com/
Disallow /wp-login*
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/cache/
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /cgi-bin/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /*.php$
Disallow /*?feed=
Disallow /*/feed/rss/$
Disallow /trackback/
Disallow */trackback/
Disallow */feed/
Disallow /*~*
Disallow /*~

Other Records

Field Value
sitemap https://www.countrythangdaily.com/sitemap_index.xml
sitemap https://www.countrythangdaily.com/post-sitemap.xml
sitemap https://www.countrythangdaily.com/page-sitemap.xml

Comments

  • Allow files critical for rendering
  • Allow AJAX - Do Not Remove
  • Allow AJAX - Do Not Remove
  • General Best Practice WP Disallows
  • - J Sevillejo
  • Add all sitemaps