surajherbals.com
robots.txt

Robots Exclusion Standard data for surajherbals.com

Resource Scan

Scan Details

Site Domain surajherbals.com
Base Domain surajherbals.com
Scan Status Ok
Last Scan2025-10-19T11:19:56+00:00
Next Scan 2025-11-18T11:19:56+00:00

Last Scan

Scanned2025-10-19T11:19:56+00:00
URL https://surajherbals.com/robots.txt
Domain IPs 104.21.46.108, 172.67.138.56, 2606:4700:3037::6815:2e6c, 2606:4700:3037::ac43:8a38
Response IP 172.67.138.56
Found Yes
Hash e1dc71d5832f14f528216f9b6aee2bca8e4a3803054fa36666c33a46e83cfa36
SimHash 4801d940eb13

Groups

*

Rule Path
Allow /
Allow /blog/wp-content/uploads/
Disallow /blog/wp-content/plugins/
Disallow /blog/wp-admin/
Allow /blog/wp-admin/admin-ajax.php
Disallow /blog/readme.html
Disallow /blog/refer/

Other Records

Field Value
sitemap https://www.surajherbals.com/sitemaps/sitemap-index.xml
sitemap https://www.surajherbals.com/blog/sitemap_index.xml