taxdarpan.com
robots.txt
Robots Exclusion Standard data for taxdarpan.com
Resource Scan
Scan Details
| Site Domain | taxdarpan.com |
| Base Domain | taxdarpan.com |
| Scan Status | Ok |
| Last Scan | 5/31/2025, 6:44:20 PM |
| Next Scan | 6/7/2025, 6:44:20 PM |
Last Scan
| Scanned | 5/31/2025, 6:44:20 PM |
| URL | https://taxdarpan.com/robots.txt |
| Domain IPs | 135.181.70.92 |
| Response IP | 135.181.70.92 |
| Found | Yes |
| Hash | 3d0dc694ea9cc6d1314322a65909ac02f2b53142c6c8ef5077c4713449db254c |
| SimHash | 79be5805e483 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /wp-login.php |
| Disallow | /wp-comments.php |
| Disallow | /tag/ |
| Disallow | /1index.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-includes/ |
| Disallow | /xxx/ |
| Disallow | /css.php |
| Disallow | /dublin |
| Disallow | /wp-content/ |
| Disallow | /wpt/ |
| Disallow | /cache/ |
| Disallow | /wp/ |
| Disallow | /wp-blog.php |
| Disallow | /wp-admin/ |
| Disallow | /assets/ |
| Disallow | /wp-cli/ |
| Disallow | /wordpress/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /wp-login.php |
| Disallow | /wp-comments.php |
| Disallow | /tag/ |
| Disallow | /1index.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-includes/ |
| Disallow | /xxx/ |
| Disallow | /css.php |
| Disallow | /dublin |
| Disallow | /wpt/ |
| Disallow | /cache/ |
| Disallow | /wp/ |
| Disallow | /wp-blog.php |
| Disallow | /wp-admin/ |
| Disallow | /assets/ |
| Disallow | /wp-cli/ |
| Disallow | /wordpress/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /wp-login.php |
| Disallow | /wp-comments.php |
| Disallow | /tag/ |
| Disallow | /1index.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-includes/ |
| Disallow | /xxx/ |
| Disallow | /css.php |
| Disallow | /dublin |
| Disallow | /wpt/ |
| Disallow | /cache/ |
| Disallow | /wp/ |
| Disallow | /wp-blog.php |
| Disallow | /wp-admin/ |
| Disallow | /assets/ |
| Disallow | /wp-cli/ |
| Disallow | /wordpress/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /wp-login.php |
| Disallow | /wp-comments.php |
| Disallow | /tag/ |
| Disallow | /1index.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-includes/ |
| Disallow | /xxx/ |
| Disallow | /css.php |
| Disallow | /dublin |
| Disallow | /wpt/ |
| Disallow | /cache/ |
| Disallow | /wp/ |
| Disallow | /wp-blog.php |
| Disallow | /wp-admin/ |
| Disallow | /assets/ |
| Disallow | /wp-cli/ |
| Disallow | /wordpress/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
slurp
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /bin/ |
| Disallow | /wp-login.php |
| Disallow | /wp-comments.php |
| Disallow | /tag/ |
| Disallow | /1index.php |
| Disallow | /wp-cron.php |
| Disallow | /wp-includes/ |
| Disallow | /xxx/ |
| Disallow | /css.php |
| Disallow | /dublin |
| Disallow | /wpt/ |
| Disallow | /cache/ |
| Disallow | /wp/ |
| Disallow | /wp-blog.php |
| Disallow | /wp-admin/ |
| Disallow | /assets/ |
| Disallow | /wp-cli/ |
| Disallow | /wordpress/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://taxdarpan.com/sitemap.xml |