cleartrip.com
robots.txt
Robots Exclusion Standard data for cleartrip.com
Resource Scan
Scan Details
| Site Domain | cleartrip.com |
| Base Domain | cleartrip.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-06-15T17:25:26+00:00 |
| Next Scan | 2024-08-14T17:25:26+00:00 |
Last Successful Scan
| Scanned | 2024-04-10T15:54:08+00:00 |
| URL | https://cleartrip.com/robots.txt |
| Redirect | https://www.cleartrip.com/robots.txt |
| Redirect Domain | www.cleartrip.com |
| Redirect Base | cleartrip.com |
| Domain IPs | 34.95.116.11 |
| Redirect IPs | 34.95.116.11 |
| Response IP | 34.95.116.11 |
| Found | Yes |
| Hash | 0eea22cb0f8ce842aab7f6646210163294133e0dcdbd68665b9c08b644afff0f |
| SimHash | 656e7d033c8b |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cgi-bin/ |
| Disallow | /forums/35 |
| Disallow | /forums/38 |
| Disallow | /flights/results |
| Disallow | /flights/search |
| Disallow | /trains/results |
| Disallow | /trains/search |
| Disallow | /packages/search |
| Disallow | /packages/results |
| Disallow | /bus/results |
| Disallow | /bus/chart |
| Disallow | /bus/itinerary/travellers |
| Disallow | /pay/bus |
| Disallow | /bus/confirmation |
| Disallow | /m/flights/results |
| Disallow | /m/flights/search |
| Disallow | /m/hotels/results |
| Disallow | /m/hotels/search |
| Disallow | /m/trains/results |
| Disallow | /m/trains/search |
| Disallow | /m/flights/international/results |
| Disallow | /m/flights/international/results |
| Disallow | /flights/international/results |
| Disallow | /flights/international/search |
| Disallow | /smallworld/* |
| Disallow | /hotels/info* |
| Disallow | /hotels/info/* |
| Disallow | /alerts* |
| Disallow | /users/ |
| Disallow | /urltrack/ |
| Disallow | /themes_holidays/ |
| Disallow | /promotions/ |
| Disallow | /promos/ |
| Disallow | /forums/ |
| Disallow | /itinerary/ |
| Disallow | /waytogo/* |
| Disallow | /hotels/search |
| Disallow | /hotels/results |
| Disallow | /sem-flights-lp |
| Disallow | /sem-flights-offer-lp |
| Disallow | /signin/ |
| Disallow | /account/ |
| Disallow | /signinstatic/ |
| Disallow | /sem-hotels-lp |
| Disallow | /html/ |
| Disallow | /domesticair/bookflow/emailId |
| Disallow | /domesticair/bookflow/TravellerInfo |
| Disallow | /partners/dashboard |
| Disallow | /messages/500.shtml |
| Disallow | /insurance/ |
| Disallow | /m/signin?service=%2Fm%2Ftrips |
| Disallow | /ticket/view |
| Disallow | /m/signin |
| Disallow | /register |
| Disallow | /payment/return/tpsl |
| Disallow | /reset |
| Disallow | /local/signin |
| Disallow | /wl/expedia/trips |
| Disallow | /internationalair/bookflow/emailId |
| Disallow | /bookflow/TravellerInfo |
| Disallow | /hotel/bookflow/MakePayment |
| Disallow | /api/ |
| Disallow | /hotels/itinerary/* |
| Disallow | /flights/itinerary/* |
| Disallow | /trains/itinerary/* |
| Disallow | /local/itinerary/* |
| Disallow | /packages/itinerary/* |
| Disallow | /payment/itinerary/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cleartrip.com/sitemap-index.xml |
| sitemap | https://www.cleartrip.com/hotels/seo-sitemap/hotel-sitemap-index.xml |