cntraveller.in
robots.txt
Robots Exclusion Standard data for cntraveller.in
Resource Scan
Scan Details
Site Domain | cntraveller.in |
Base Domain | cntraveller.in |
Scan Status | Ok |
Last Scan | 2024-09-28T08:19:20+00:00 |
Next Scan | 2024-10-05T08:19:20+00:00 |
Last Scan
Scanned | 2024-09-28T08:19:20+00:00 |
URL | https://www.cntraveller.in/robots.txt |
Domain IPs | 13.225.4.109, 13.225.4.34, 13.225.4.49, 13.225.4.8, 2600:9000:21b4:1e00:1f:d82e:8bc0:93a1, 2600:9000:21b4:200:1f:d82e:8bc0:93a1, 2600:9000:21b4:2a00:1f:d82e:8bc0:93a1, 2600:9000:21b4:5400:1f:d82e:8bc0:93a1, 2600:9000:21b4:7000:1f:d82e:8bc0:93a1, 2600:9000:21b4:ba00:1f:d82e:8bc0:93a1, 2600:9000:21b4:c000:1f:d82e:8bc0:93a1, 2600:9000:21b4:cc00:1f:d82e:8bc0:93a1 |
Response IP | 13.225.4.49 |
Found | Yes |
Hash | bc36b676560de958bcfa8e14ce3f690e78fa6122789932a6b5865e1384438c8d |
SimHash | 459e53c3cb94 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /5574/ |
Disallow | /?* |
Disallow | /top-restaurant-awards-participating-list/ |
Disallow | /top-restaurants-2017-participate/ |
Disallow | /*?redirectURL= |
Disallow | /*%7B%7Burl%7D%7D |
Disallow | /*%7B%7Burl%7D%7D |
Disallow | /*%7B%7Bsection%7D%7D |
Disallow | /*%7B%7Bsection%7D%7D |
Disallow | /auth/* |
Disallow | /account/* |
Disallow | /admin/ |
Disallow | /product/ |
Disallow | /user-context?referrer |
Disallow | /services.min.js?_= |
Disallow | /preview/ |
Disallow | /search/ |
Disallow | /CNMaxMind/index.php |
googlebot
Rule | Path |
---|---|
Allow | / |
Disallow | /*?redirectURL= |
Disallow | /*%7B%7Burl%7D%7D |
Disallow | /*%7B%7Burl%7D%7D |
Disallow | /*%7B%7Bsection%7D%7D |
Disallow | /*%7B%7Bsection%7D%7D |
Disallow | /auth/* |
Disallow | /account/* |
Disallow | /product/ |
Disallow | /user-context?referrer |
Disallow | /services.min.js?_= |
Disallow | /search/ |
Disallow | /CNMaxMind/index.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.cntraveller.in/sitemap.xml |
sitemap | https://www.cntraveller.in/sitemap-news.xml |
sitemap | https://www.cntraveller.in/feed/google-latest-news/sitemap-google-news |
sitemap | https://www.cntraveller.in/sitemap-wp.xml |
sitemap | https://www.cntraveller.in/contributors-sitemap.xml |
sitemap | https://www.cntraveller.in/categories-sitemap.xml |
sitemap | https://www.cntraveller.in/branded-sitemap.xml |
sitemap | https://www.cntraveller.in/bundles-sitemap.xml |