cleartax.in
robots.txt

Robots Exclusion Standard data for cleartax.in

Resource Scan

Scan Details

Site Domain cleartax.in
Base Domain cleartax.in
Scan Status Ok
Last Scan2024-09-25T06:15:16+00:00
Next Scan 2024-10-09T06:15:16+00:00

Last Scan

Scanned2024-09-25T06:15:16+00:00
URL https://cleartax.in/robots.txt
Domain IPs 13.35.238.105, 13.35.238.120, 13.35.238.37, 13.35.238.54
Response IP 13.35.238.54
Found Yes
Hash f1942801a6e3c7b21d53aa11c6d07cd990f4c32e389ed0f090f4fad181080243
SimHash 69c4fc452193

Groups

*

Rule Path
Disallow /save/api/
Disallow /save/search/
Disallow /stocks/screener/?*
Disallow /*?utm*

Other Records

Field Value
sitemap https://cleartax.in/gst-sitemap.xml
sitemap https://cleartax.in/income-tax-sitemap.xml
sitemap https://cleartax.in/product-sitemap.xml
sitemap https://cleartax.in/services-sitemap.xml
sitemap https://cleartax.in/smb-sitemap.xml
sitemap https://cleartax.in/static-sitemap.xml
sitemap https://cleartax.in/tax-saving-sitemap.xml
sitemap https://cleartax.in/tds-sitemap.xml
sitemap https://cleartax.in/index-sitemap.xml
sitemap https://cleartax.in/save/sitemap.xml
sitemap https://cleartax.in/v/taxlibrary-sitemap.xml
sitemap https://cleartax.in/stocks/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449