cleartax.com
robots.txt

Robots Exclusion Standard data for cleartax.com

Resource Scan

Scan Details

Site Domain cleartax.com
Base Domain cleartax.com
Scan Status Ok
Last Scan2024-05-24T13:54:57+00:00
Next Scan 2024-06-23T13:54:57+00:00

Last Scan

Scanned2024-05-24T13:54:57+00:00
URL https://cleartax.com/robots.txt
Redirect https://www.cleartax.com/robots.txt
Redirect Domain www.cleartax.com
Redirect Base cleartax.com
Domain IPs 18.172.21.19, 18.172.21.56, 18.172.21.81, 18.172.21.96
Redirect IPs 18.172.21.19, 18.172.21.56, 18.172.21.81, 18.172.21.96, 2600:9000:2481:1800:13:dd25:1cc0:93a1, 2600:9000:2481:2200:13:dd25:1cc0:93a1, 2600:9000:2481:4a00:13:dd25:1cc0:93a1, 2600:9000:2481:ae00:13:dd25:1cc0:93a1, 2600:9000:2481:b800:13:dd25:1cc0:93a1, 2600:9000:2481:d400:13:dd25:1cc0:93a1, 2600:9000:2481:f000:13:dd25:1cc0:93a1, 2600:9000:2481:fc00:13:dd25:1cc0:93a1
Response IP 13.225.4.35
Found Yes
Hash bf5b8a038284a616d0c1125cd75eb61e13a310c68575c29d78463f8d5de17b42
SimHash 4149c541c751

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.cleartax.com/sitemap-ksa-arabic.xml
sitemap https://www.cleartax.com/sitemap-ksa.xml
sitemap https://www.cleartax.com/ae/sitemap.xml
sitemap https://www.cleartax.com/om/sitemap.xml
sitemap https://www.cleartax.com/bh/sitemap.xml
sitemap https://www.cleartax.com/sa/sitemap-arabic.xml
sitemap https://www.cleartax.com/sa/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449