keshavblog.com
robots.txt

Robots Exclusion Standard data for keshavblog.com

Resource Scan

Scan Details

Site Domain keshavblog.com
Base Domain keshavblog.com
Scan Status Ok
Last Scan2025-09-03T09:20:33+00:00
Next Scan 2025-09-10T09:20:33+00:00

Last Scan

Scanned2025-09-03T09:20:33+00:00
URL https://keshavblog.com/robots.txt
Domain IPs 2a02:4780:2b:1870:0:17a8:cd76:6, 46.202.182.36
Response IP 46.202.182.36
Found Yes
Hash 7907c70b9010c63a74ea08c2c11a5f0df20f740c6c05b3a20dc1dfa6ff68b480
SimHash 6080dc4b05ba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Allow /*.css$
Allow /*.js$
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://keshavblog.com/sitemap_index.xml

Comments

  • Prevent indexing of search results and duplicate pages
  • Allow all CSS, JS, and image files for proper rendering
  • Sitemap for better indexing