insider.in
robots.txt

Robots Exclusion Standard data for insider.in

Resource Scan

Scan Details

Site Domain insider.in
Base Domain insider.in
Scan Status Ok
Last Scan2024-11-06T08:40:11+00:00
Next Scan 2024-11-20T08:40:11+00:00

Last Scan

Scanned2024-11-06T08:40:11+00:00
URL https://insider.in/robots.txt
Domain IPs 13.33.88.104, 13.33.88.22, 13.33.88.24, 13.33.88.39
Response IP 13.33.88.22
Found Yes
Hash fef7c70a67ba15121b2b920f9a3a5c4cc7ac0c7f6c04f655da98345beb4f0b4c
SimHash 24dcef60f093

Groups

*

Rule Path
Disallow /users
Disallow /checkout
Disallow /internal.weekender.insider.in/
Disallow /rss
Disallow /event/test
Disallow /*buy
Disallow /payments
Disallow /search
Disallow /*?platform=*
Disallow /*?type=*