gadgetsnow.indiatimes.com
robots.txt
Robots Exclusion Standard data for gadgetsnow.indiatimes.com
Resource Scan
Scan Details
Site Domain | gadgetsnow.indiatimes.com |
Base Domain | indiatimes.com |
Scan Status | Ok |
Last Scan | 2024-10-14T08:22:17+00:00 |
Next Scan | 2024-11-13T08:22:17+00:00 |
Last Scan
Scanned | 2024-10-14T08:22:17+00:00 |
URL | https://gadgetsnow.indiatimes.com/robots.txt |
Domain IPs | 23.59.168.123, 23.59.168.96, 2600:1413:b000:1c::17d1:2ec6, 2600:1413:b000:1c::17d1:2ee1 |
Response IP | 23.59.168.123 |
Found | Yes |
Hash | 30955caf234c9604546815f24a43c3d29937c5d994c91367a5e6e42ab970ea38 |
SimHash | cd54c9a0df33 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */affiliate_amazon.cms* |
Disallow | */affiliate_tatacliq.cms* |
Disallow | */affiliate_paytm.cms* |
Disallow | */affiliate_vijaysales.cms* |
Disallow | */back/* |
Disallow | */back |
Disallow | /privacypolicy |
Disallow | */affiliate.cms* |