monkoodog.com
robots.txt

Robots Exclusion Standard data for monkoodog.com

Resource Scan

Scan Details

Site Domain monkoodog.com
Base Domain monkoodog.com
Scan Status Ok
Last Scan2024-10-31T20:57:48+00:00
Next Scan 2024-11-07T20:57:48+00:00

Last Scan

Scanned2024-10-31T20:57:48+00:00
URL https://monkoodog.com/robots.txt
Domain IPs 2a02:4780:39:fca8:a114:8a0:c2f4:215e, 84.32.84.18
Response IP 77.37.66.197
Found Yes
Hash 0afc3dfddb0bb769d3b3da1d1bf2bba13b2221a7bf268ff3c786b1cda577e2c9
SimHash 6144fddb6750

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt

Other Records

Field Value
sitemap https://monkoodog.com/sitemap/

Comments

  • Allow major search engines to crawl the entire site
  • Disallow access to specific WordPress directories
  • Disallow access to unnecessary files
  • Disallow access to specific files or directories if needed
  • Disallow: /wp-content/uploads/private-files/
  • Optional: Sitemaps for better indexing (replace with your actual sitemap URL)