doctorsdirectory.com.bd
robots.txt

Robots Exclusion Standard data for doctorsdirectory.com.bd

Resource Scan

Scan Details

Site Domain doctorsdirectory.com.bd
Base Domain doctorsdirectory.com.bd
Scan Status Ok
Last Scan2025-12-19T19:50:34+00:00
Next Scan 2026-01-18T19:50:34+00:00

Last Scan

Scanned2025-12-19T19:50:34+00:00
URL https://doctorsdirectory.com.bd/robots.txt
Domain IPs 104.21.22.170, 172.67.205.241, 2606:4700:3036::6815:16aa, 2606:4700:3036::ac43:cdf1
Response IP 172.67.205.241
Found Yes
Hash 13b32d76a00f2855f7aead9716bfd0c5d69aadff7337da21458289d3be6a2ab6
SimHash 6b2078eb2cbb

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Allow /wp-admin/admin-ajax.php -
Disallow /wp-includes/ -
Disallow /wp-content/plugins/*.php -
Disallow /wp-content/themes/*.php -
Disallow /wp-content/cache/ -
Disallow /wp-login.php -
Disallow /xmlrpc.php -
Disallow /trackback/ -
Disallow /readme.html -
Disallow /?s= Prevents indexing of internal search queries (Duplicate Content)
Disallow /search/ Prevents search pages from indexing
Disallow /feed/ -
Disallow /chamber/ -
Disallow /district/ -
Disallow /division/ -
Disallow /speciality/ -
Disallow /category/ -
Disallow /*/feed/ -
Disallow /*/page/ Prevents duplicate pagination issues
Disallow /*?replytocom Blocks unnecessary comment URL variations
Disallow /rss/ -
Allow /wp-content/uploads/ -
Allow /wp-content/plugins/*.css -
Allow /wp-content/plugins/*.js -
Allow /wp-content/themes/*.css -
Allow /wp-content/themes/*.js -
Allow /wp-includes/*.css -
Allow /wp-includes/*.js -

Other Records

Field Value
sitemap https://doctorsdirectory.com.bd/sitemap_index.xml

Comments

  • Allow important assets for rendering
  • XML Sitemap for faster indexing