kaarwan.com
robots.txt

Robots Exclusion Standard data for kaarwan.com

Resource Scan

Scan Details

Site Domain kaarwan.com
Base Domain kaarwan.com
Scan Status Ok
Last Scan2025-08-31T05:00:52+00:00
Next Scan 2025-09-30T05:00:52+00:00

Last Scan

Scanned2025-08-31T05:00:52+00:00
URL https://kaarwan.com/robots.txt
Redirect https://www.kaarwan.com/robots.txt
Redirect Domain www.kaarwan.com
Redirect Base kaarwan.com
Domain IPs 3.165.102.115, 3.165.102.23, 3.165.102.45, 3.165.102.84
Redirect IPs 2600:9000:2721:3400:4:e224:b580:93a1, 2600:9000:2721:4a00:4:e224:b580:93a1, 2600:9000:2721:5800:4:e224:b580:93a1, 2600:9000:2721:6200:4:e224:b580:93a1, 2600:9000:2721:a600:4:e224:b580:93a1, 2600:9000:2721:ce00:4:e224:b580:93a1, 2600:9000:2721:e00:4:e224:b580:93a1, 2600:9000:2721:ec00:4:e224:b580:93a1, 3.165.102.115, 3.165.102.23, 3.165.102.45, 3.165.102.84
Response IP 3.165.102.45
Found Yes
Hash 811d14041ef387bb3f0c479823d3582b5af239306894f3407eda9efd720568b3
SimHash 8b5895d40b30

Groups

*

Rule Path
Allow /
Disallow /payments/
Disallow /dashboard
Disallow /dashboard/
Disallow /kaarwan/blogs-sitemap-generator
Disallow /blog/ui-ux-design/a?id=826
Disallow /certification
Disallow /certification/

Other Records

Field Value
sitemap https://www.kaarwan.com/sitemap.xml