flights-us.gotogate.com
robots.txt
Robots Exclusion Standard data for flights-us.gotogate.com
Resource Scan
Scan Details
| Site Domain | flights-us.gotogate.com |
| Base Domain | gotogate.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T03:29:22+00:00 |
| Next Scan | 2024-10-04T03:29:22+00:00 |
Last Scan
| Scanned | 2024-09-20T03:29:22+00:00 |
| URL | https://flights-us.gotogate.com/robots.txt |
| Domain IPs | 23.50.90.53, 2600:1413:b000:385::31be, 2600:1413:b000:398::31be |
| Response IP | 23.41.79.242 |
| Found | Yes |
| Hash | 9c739ba524c35a5a8f03c73b084896fca57928b8d36dc34a74637c3cf9b04fa0 |
| SimHash | b80c7600e872 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax* |
| Disallow | /*.action$ |
| Disallow | /rf/mobile-travel-plan/* |
| Disallow | /from/ |
| Disallow | /top/ |
| Disallow | /rf/result |
| Disallow | /rf/traveler-details |
| Disallow | /rf/payment |
| Disallow | /rf/order-login |
| Disallow | /order-ntd-generate-ref/ |
| Disallow | /payment |
| Disallow | /sourcefiles/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://flights-us.gotogate.com/sitemap.xml |